Open Stack

Summary

Highlights

• OpenStack serves as a cloud operating system managing compute, storage, and networking resources. 🌐
• It facilitates IaaS by providing virtual machines on-demand along with networking and storage solutions. 🔄
• Major components include Nova (compute), Neutron (networking), and Swift (storage), each enhancing cloud functionalities. 📦
• The platform is highly customizable allowing for the creation and management of private clouds. 🔧
• Originally started in 2010, OpenStack has grown into a robust platform with numerous updates. 📈

Key Takeaways

• OpenStack is a versatile open-source cloud computing platform offering IaaS capabilities. 🚀
• It provides a comprehensive range of components like Nova, Neutron, Swift, and more for cloud management. 🛠️
• OpenStack supports a variety of services including compute, storage, and networking, managed via a dashboard. 🖥️
• It originated from a collaboration between NASA and Rackspace and continues to evolve with regular updates. 🌟
• OpenStack's open-source nature makes it accessible for educational and experimental purposes. 🎓

Overview

Chapters

• 00:00 - 00:30: Introduction to Open Stack In this chapter titled 'Introduction to Open Stack', the discussion revolves around cloud computing, specifically focusing on Open Stack, which is an open source cloud platform. The chapter includes a demonstration of Open Stack and its popular use in the cloud computing space.
• 00:30 - 01:00: Overview of Open Stack The chapter provides a brief overview of OpenStack, which is used for Infrastructure as a Service (IaaS) cloud solutions. It includes a demonstration on how OpenStack can be configured and how virtual machines (VMs) can be provisioned.
• 01:00 - 01:30: Open Stack Capabilities "Open Stack Capabilities" explores the features and abilities of OpenStack as a popular open source cloud platform. Highlighting its versatility, the chapter discusses how OpenStack can be downloaded and installed on various hardware configurations, enabling users to create an infrastructure-as-a-service (IaaS) cloud. It serves as a cloud operating system that manages large pools of compute and storage resources, demonstrating its role in cloud computing.
• 02:00 - 02:30: Networking in Open Stack In the chapter 'Networking in Open Stack', networking resources are discussed in the context of a data center. These resources can be managed through a dashboard, which allows administrators to maintain control while granting users the ability to provision resources through a web interface. Essentially, this setup acts as a layer above the base metal resources, enhancing management and usability.
• 03:00 - 03:30: Open Stack Storage Services Open Stack Storage Services is a cloud infrastructure that allows administrators to control virtual machine resources. It functions as a type of cloud service where users can provision virtual machines. Being open source, it can be downloaded, installed, and used to manage resources. An experimental cloud called Meghamala, based on Open Stack, has been developed at IIT Kharagpur to explore these capabilities.
• 04:30 - 05:00: Open Stack Identity Service (Keystone) The chapter discusses the Open Stack Identity Service, known as Keystone. It highlights the flexibility of Open Stack, which can be installed on various platforms, including blade servers and PCs. This adaptability is particularly beneficial for small student projects, offering practical insights into cloud infrastructure. Open Stack's capabilities encompass all essential services, making it a comprehensive solution for understanding and working with cloud technologies.
• 05:30 - 06:00: Open Stack Image Services (Glance) The chapter discusses the layers of cloud services, focusing on Open Stack Image Services (Glance). It highlights the Infrastructure as a Service (IaaS) as the base layer providing compute, network, and storage resources. It also mentions Platform as a Service (PaaS) and Software as a Service (SaaS) sitting above IaaS, with cloud access through browsers or thin clients. Glance is part of IaaS, facilitating operations on physical servers like CPU and RAM.
• 07:00 - 07:30: Open Stack Telemetry Service (Ceilometer) This chapter discusses the functionalities of the Open Stack Telemetry Service, also known as Ceilometer. The primary focus is on its capability to function as an infrastructure-as-a-service, providing Virtual Machines (VMs) on demand. The process of provisioning and snapshotting VMs is highlighted, indicating the platform's flexibility and the efficiency of managing virtual resources in storage data center networks.
• 08:30 - 09:00: Open Stack Dashboard (Horizon) The Open Stack Dashboard, also known as Horizon, offers various features including networking provisions, storage for virtual machines (VMs) and arbitrary files, and multi-tenancy quotas. Users can belong to multiple projects allowing for a versatile user experience. The dashboard facilitates effective management of resources and user allocations.
• 11:30 - 12:00: Open Stack Architecture The chapter titled 'Open Stack Architecture' discusses the fundamental aspects and benefits of OpenStack as a cloud computing platform. OpenStack offers a comprehensive cloud experience by allowing both administrative and physical control due to its open-source nature. It is highly favored by individual users, groups, or labs for installation and operational purposes as it provides users with hands-on control over both hardware and software components. This feature makes it a popular choice among users who require a flexible and controlled cloud environment.
• 29:30 - 30:00: Open Stack Storage Concepts This chapter discusses Open Stack Storage Concepts. It emphasizes the practical experience students can gain by installing Open Stack on small-scale setups like personal computers or laptops. The discussion highlights ongoing research in resource management, power management, and the emerging topic of green cloud technologies. It encourages hands-on implementation of open-source cloud solutions to understand underlying concepts and current trends in cloud technology.
• 31:30 - 32:00: Summary of Open Stack Services OpenStack is a notable open-source cloud platform that originated from a collaboration between NASA and Rackspace. It provides a framework to experiment with different parameters and experience various types of open-source cloud services.

Open Stack Transcription

• 00:00 - 00:30 hello ah so we will continue our discussion on cloud computing today we will discuss and so a demo on a open source cloud ah which is ah open stack one of the very popular open
• 00:30 - 01:00 source cloud so we will initially we will have a ah some brief overview of open stack ah then we will so a demo on open open ah open stack right that how way open stack can be configured v m can be provision primarily we have been use these open stack for i a s type of cloud infrastructure as a service type of ah cloud that we will we will demonstrate
• 01:00 - 01:30 today right so ah if you see open stack one of the ah very popular open source cloud which you can download and install in a in in a particular ah hardware configuration even with couple of species with you can ah install your open stack and see ah the performance of a i a s type of cloud so open stack ah is a cloud operating system that controls large pool of compute storage
• 01:30 - 02:00 networking resources through a data centre throughout a data centre all manage through dashboard and hm and gives administrator control and while empowering their users provisioning you resources on the through a wave interface so what it says its say a its you have a set of resources ah it is it is a layer above those base this they are metal resources and
• 02:00 - 02:30 it gives the administrator to control these resources and the user can basically provisions v ms ah out of it so its say ah a it access a i a s type of cloud and as it is as we mentioned it is a open source so you can download and install and give it provision of the things incidentally in i i t kharagpur we have a done experimental we have made experimental cloud called meghamala which is based on open stack and which which has been ah install
• 02:30 - 03:00 over blade server ah but never the less open stack you can install over p c is here also we have tried with p c is etcetera for small small student projects so its gives a feel that how a particular infrastructure as a cloud works and also how we can work on those things so as for as the open stack capability is there so it provide it has the capability of all the services
• 03:00 - 03:30 though primarily ah we use more as the infrastructure as a service so at the infrastructure as a service provision come compute network storage at the pass level on top of i a s cloud foundry and over the as the sass level that browser or thin client accesses right so these are the ah these are the whole ah pyramid of typical cloud services ah which is accessible over internet so infrastructure as a service where you have physical serve as like c p u ram
• 03:30 - 04:00 storage data center networks etcetera over that some developers service and over that some software as a service now if you look at the capability of open stack so primarily if you look at from point point of view as infrastructure of service so it is a v ms it it can give v ms on demand right so it is both provisioning and snap ah shotting is possible so it is virtual machine
• 04:00 - 04:30 on demand it has a provision for networking alright it has a provision for networking it has storage for v ms and arbitrary files right so you can have storage for ah for virtual machines and other files and ah supports ah multi tenancy quotas for different project users ah user can be associated with multi projects and type of things right so ah in
• 04:30 - 05:00 essence its its its gives you a full fledge experience of a cloud and and as the as it is a open source your installing so you have the control ah both administrative and physical control over the whole thing so the hardware users and and your running on the things so it is if a good thing or it is a very popular thing ah for individual user or group or lab to install and have a
• 05:00 - 05:30 life experience and extremely useful for students ah with couple of pieces or even a couple of laptops to you can install open stack and see that how things are there as ah we mentioned earlier that there is a good amount of ah research going on on resource management in cloud ah resource management power management and right people are talking about green cloud and sort of things so this sort of ah lab scale ah implementation of open source clouds
• 05:30 - 06:00 may help in having ah experience and experimentation of different type of parameters on the so one open stack is one one of the ah one of the very popular such a open ah open source skew so if you look at a history of the cloud a history of open stack ah those sta its started with a collaboration between na nasa and rack
• 06:00 - 06:30 space and over years it has gone through different project mode and you can see that it started with ah around twenty ten and we are ah its its we are having releases ah regular releases ah with ah over years so if it is if you see there is started with a pro project col austin and go on going to
• 06:30 - 07:00 that neutron and ah pike and queens which are to be ah declare so if you low if we look at the overall architecture of open stack ah there are a couple of components ah like one is that horizon which is primarily the a dashboard which invite the dashboard project
• 07:00 - 07:30 horizon so project neutron which is the mostly look at the networking ah cinder which ah primary look at the block storage of open stack nova is the compute ah ah glance is the image services the different type of different image services which can be hosted in the open stack is there ah then we have ah other things like swift which is object storage like we have cinder as block storage so object storage is swift then ceilometer which is
• 07:30 - 08:00 ceilometer which is the telemetry ah services keystone is the idea identity services ah so we what we can see that this all all different sort of services which are which are required in a typical cloud are there in open stack right so though they though some they developed a in in different ah project mode but it it
• 08:00 - 08:30 comes as a ah bundle and we can have when we have installations we have all these flavor into the things so its say good to have a feel of the cloud and you can have operational cloud using ah your own internal or in house cloud using these are type of open source so things it is less costly you have to pay for the infrastructure and if you have a one infrastructure as i means already present or access infrastructure already present ah
• 08:30 - 09:00 which can be which we can deployed in to the ah using open stack or any other open source cloud so if you you have if you look at from the point of view ah then you have the standard hydroid like the backbone then the open stack shear services and over that we have compute networking storage services right and so this and then their open stack dashboard and the
• 09:00 - 09:30 the services we talked about so the user applications come from the top and it is it it goes on to this overall ah inform a a p is and utilizes this different services to ah execute particular or realize particular job I would like to mention the here that we have taken most of this resources from again open stack site and other resources so this other things which you can get in
• 09:30 - 10:00 right that also so if you look at the major components as we are mentioning here if you just go back like ah horizon neutron cinder nova glance swift ah ceilometer and keystone so these are the major component so so we will just have a brief ah overview of these components ah before we see a ah demo ah on those things right so one of the major one
• 10:00 - 10:30 of the critical components compute which is a which the service is compute and the project is a nova project so managers the life cycle of compute instances in a open stack environment right it manages the life cycle of a compute instances in a open stack environment responsibilities includes spawning scheduling decommissioning of virtual machine on demand right
• 10:30 - 11:00 so ah it it is the it it primarily work with this v i m ah scheduling v i m and decommissioning or releasing the virtual machine on all on demand right so so it if you look at it manages the whole compute cycle so if you if you see that there are different type of flavor for
• 11:00 - 11:30 v ms with different configuration a typical cloud environment here also we can have different flavor of v ms so i will user request that through the dashboard ah the manager or the controller of the cloud can allocate different v ms to these different to the user based on the requirement so it comes with a storage the familiar storage ah and a persistent storage which can be associated with this v ms right so this ah this are ah possible using this
• 11:30 - 12:00 ah compute or nova services another aspects is the networking ah another measure service is the networking which is which is under the neutron thing enables network connectivity as a service for other open stack service is such as open stack compute another things so if you have other open stack surface like compute or nova storage services and so on
• 12:00 - 12:30 so is ah this neutron or the networking provide a networking as a service to this to this different component of open stack right so provides an a p i ah for users to define network and attachment to them right so ah it provides a p i to the users to define networks and attach ah how to attach the things so if you look at any cloud in first types so two type
• 12:30 - 13:00 of networks are prominent their one is the internal network which is internal to the cloud and there is a external network to the which is external to the cloud right so like if as you are talking about that we have a hm open source cloud in in our institute that what we called at meghamala we experimental open source using open stack with a very ah only experimental cloud which i have being used by ah faculty and research scholars were
• 13:00 - 13:30 there computing primarily the computing needs ah its its comes with different favor we will so that example and how we do so it as a internal network right internal network for the cloud where as the external network for that cloud is basically that in network right so as it is a in house cloud so this is not accessible from the external world however the cloud itself has a internal thing which is which is for compute which is for communicating between is we defined component and providing services and as a external link which gives a connectivity to
• 13:30 - 14:00 the external one so it is it based on this ah neutron type of services if you are using open stack so it has a pluggable architecture that supports many popular networking vendors and technology so that is it is ah interoperable between different networking vendors and technologies so that is ah feasible in open stack the next one is the storage service which is comes
• 14:00 - 14:30 under project swift store and retrieves arbitrary structure unstructured data ah objects as a restful h t t p based a p i right so its a stores and retrieves unstructured data objects as a restful hm i i believe that you know you understand about restful services restful and h t t p based a p i so it is highly
• 14:30 - 15:00 fault tolerant with data replication and scale out architecture its implementation is not like file server with multiple directories etcetera so its a basically a falter and system with a scale out architecture ah its not they simple file server so it is much more than that and in this case it rights objects and files to multiple devices ensuring the data is replicated across the server clusters so in order to make falter and it is dies into
• 15:00 - 15:30 the things as if you remember when we are talking about data ah on cloud or data services on the cloud in our lecture or when we discussed about those so ah the replication is ah the scenario if discuss with the three ah three replications right so it it replicate the data into three places so whenever there is a right operations all this right will be having ah should sink with the all the all the replicas whereas in case
• 15:30 - 16:00 of read over sense in any of the replica can response to the things in whenever delays this storage service ah of swift also ah provide such structures to means ah falter and services so ah another type of storage service is your block storage which is provided by cinder provide persistents block storage to running instances right so it is a persistent block storage to the running instances is it is pluggable driver architecture facilitate the
• 16:00 - 16:30 creation and management our block storage so it is a again it is a persistent storage and persistent block storage and provides a ah pluggable driver architecture to facilitate ah creation and management of block storage things then another component we are having which is not directly under compute or hm storage but plays a vital role in realizing
• 16:30 - 17:00 the cloud is the identity service right hm or what you say keystone under the keystone project right provides authentication and authorization service for other open stack services right so its its say ah identity service and provides authorization and ah authentication of services for other things provides a catalogue of end points for all open stack sa services so also it along with that it provides a catalogue ah of end points of open sa open stack services
• 17:00 - 17:30 that how those services are defined end type of things so the ah the next component is glance or what we say that image services so it it basically open sack support separate type of images or image services where which can be loaded ah or which can be ah instantiated
• 17:30 - 18:00 into that a different v ms right so I can have different v m and different images of say operating systems and other things can be instantiated on the difference v ms based on the ah user needs and requirement so this sort of services are provided by hm that by it is glance ah project or the glance service glancing may service so it stores retrieve virtual machine disk images right
• 18:00 - 18:30 so the virtual v m disk images are are stores and retrieves by this glance and open stack compute makes use of during the instance provisioning right as we are mentioning whenever the open stack have instance provisioning ah then they use this ah storage services like you can have a this sorry this image services so like you can have different ah images say for operating systems right so you can have different flavor or uniques or other operating systems and
• 18:30 - 19:00 when you instance based on the requirement of the hm user those are instantiated ah by this compute services so this images ah image repositories are there in the open stack this is another service ah of of telemetry which is ceilometers ah monitors and ah meters the open stack cloud for billing benchmarkings scalability statistical purposes right
• 19:00 - 19:30 so this is important for overall ah metering of the of the cloud services as as we have discussed in our initial lecture as we understand that cloud is a meter service that means ah whatever uses and type of things are meter right so that mean this ah particular ceilometer or the telemetry services is in could in open stack hm helps us in real in monitoring and
• 19:30 - 20:00 metering the open stack cloud for billing benchmarking scalability statistical purposes is not only for meeting it is required that as you are having this ah measured services so you can do benchmarking the address the scalability shoes and statistical analysis like you want to know that what is the loading how it be a and type of things so those type
• 20:00 - 20:30 of things are able so its though it may not be directly contributing to the compute or storage on networking which use anything that is the major component which which allows us to work on those ah allows us in this aspect but never the less is it plays a vital role in in having ah in helping in realizing this metered service of the things along with statistical
• 20:30 - 21:00 analysis or statistical ah measurement of things to charge the performance of the things which not only help in meaning of the ah resource uses also it helps in understanding the future requirement and how the infrastructure at the backbone need to be increased and type of things it helping realizing those requirements also and maybe the train maybe the puritical
• 21:00 - 21:30 requirement I can say that every one day this is the load we cans load is less however some time it is some particular time etcetera so this overall ah for for analyzing over all the ah overall this performance of the things what we required is more about different sort of data which this ah telemetry service provides us then we have the a component of hm open
• 21:30 - 22:00 stack dashboard that is what we say ah under project horizon so its provides a web base self service portal to interact with underlining open stack services such as launching an instant assigning i p addresses and configuring access control right so a its a dashboard ah under project horizon provides a well ah web base self service portal
• 22:00 - 22:30 to interact with underline in open stack services such as launching instance launching assigning i p address and configuring will actually will so in our demo that how we are using this open stack dashboard to user management to resource management like we one to ah assign a v m ah or ah assign i p address or if an x cont means configured the access controls
• 22:30 - 23:00 ah loading images etcetera all are ah all can be done using this dashboard so it its also ah important aspects and at it is the what we can say frontend interface for the ah for the administrator to manage the cloud so its say ah its extensively used for management
• 23:00 - 23:30 of the cloud so if we ah look at the overall ah architecture then what we see that we have different components right so this is open stack object storage as we have ah discussed that is which is realize to swift ah that open stack image services which is used to glance open stack compute services which is realize to nova realized by nova there are
• 23:30 - 24:00 block storage which is cinder open stack networking ah which is the neutron right and open stack identity services which is keystone right so there is there are different type of services and if we have seen that ah horizon which allows us to ah look at the dashboard so this that open stack dashboard and this is the internet that user comes on the command line interfaces nova neutron swift etcetera cloud management tools like right
• 24:00 - 24:30 scale other tools g u i tool dashboard cyber duck and so on and so forth so there is the user interface for the things and then it basically ah based on its requirement it ah words into this so they are it shows that over ah how this overall at the top level open stack ah modules are interconnected how the process flows goes on into this open stack
• 24:30 - 25:00 module right so this is this is ah the a overview of the thing there are few more site of the individual ah component we will not go to the much nitty gitty of the thing but nitty gitty of the material but right to see that what are the different type components like if you look at the open stack workflow so these are the different components are there nova for compute cinder for block storage
• 25:00 - 25:30 ah these are the compute nodes in the nova there are other ah other components within the nova there is a cinder also have ah ah its own component neutron is the networking part ah ah network ah networking aspects so neutron a p i scheduler plug in queues etcetera these are the all networking related component we have ah ceilometer which is ah primarily
• 25:30 - 26:00 that the metering service or the telemetric component and there are keystone for the identity services so user log scene to u i specific v m parameters like name flavor keys etcetera and hits the create button right so they do it on the means when user log scene with the particular creative vm then the horizon sends the h t t p request to keystone authenticate
• 26:00 - 26:30 information as specified in the http header so horizon or the dashboard ah service says the ah the information to this identity service then we are at the the keystone sends the temporary token back to horizon via h t t p and nova a p i sends ah http request to now after that keystone sends the http then the keystone sends the temporary token back to the horizon where http horizon sends the post request to the nova a p i and send them so once that authentication is there then
• 26:30 - 27:00 the horizon sends the things to the compute server which ah in turned as it other ah operations now i finally the nova a p i sends http equates to validate a p i token to case two right so this way the whole thing goes on and if we ah look at the token exchange mechanism so the user to the keystone ah it is the for the identification or authentication then
• 27:00 - 27:30 it goes to the nova then the glance and the neutron so this is the what we say if you look at that process flow of that particular token authentication token ah uses similarly ah there is a provisioning flow nova appearing makes a r p c cast to scheduler ah scheduler picks up the message from the message queue ah scheduler fetches information about the whole plaster from the databases data base
• 27:30 - 28:00 filters selects compute nodes scheduler publishes message to the compute queues nova compute gets message from the nova message queue m q and nova compute makes r p c is equal to nova conductor and so on and so forth so that is the how that provisioning is made into the open stack right and then we have individual component ah like comp ah compute driver which are expansion of the things ah we are not going detail in to the open stack thing those
• 28:00 - 28:30 who are interested in particular things can refer to their ah resources similarly we have neutron architecture ah which is which is the networking architecture and as such neutron also have several ah component into the thing a into a under its folder the glance which is for image service so it has a glance databases can registry that what
• 28:30 - 29:00 sort of services are there then ah glance a p i and storage adopter so we have ah again if you components under the glance similarly cinder architecture which is ci cinder architecture which is for block storage so these are the measure component of the cinder that cinder databases scheduler a p i volumes and a backup service of this cinder keystone as we have
• 29:00 - 29:30 already discussed is the identity type of service and it has different different ah modules or different components policy back back in token tokenization catalogue service identity service assignment backend and credentials backend so these are the different type of
• 29:30 - 30:00 component or services under this keystone ah identity service so if you look at the open stack storage concepts it is ah in the similar line with the other cloud storage storages like ephemeral storage ah persists until the v m terminated accessible from within v m as local file systems like this is the ephemeral storage so once the v m is terminated
• 30:00 - 30:30 it also goes of used to run operating system and or scratch space like as it is ephemeral so it is primarily used to run operating system which are loaded as and when ah things are required and it is ah also can be user a scratch space ah and managed by the nova ah that we have seen block storage persist until specifically deleted by user right
• 30:30 - 31:00 so it is a block storage so it persists until specifically deleted by the user accessible within v m as a block service right used to add additional perisistent storage to ah to v m and to operating systems so it a used to add additional storage to the things otherwise you are with the v m taking as storage only and it is managed by cinder then we have a object storage which is manage by swift ah persists until specifically deleted accessible
• 31:00 - 31:30 from anywhere ah use to add ah add and store files including v m images right so this v m images which is ah which are managed by ah some of the images managed by the glance services are also ah used to add store files ah into this into the object storage and this and the object storage is managed by as we have discussed earlier is the by swift
• 31:30 - 32:00 so in summary ah if you have a quick overview of the whole ah this open stack the user logs in horizon and initiates the v m creation keystone authorizes it nova initiates provisioning and saves state to the database nova scheduler finds i appropriate host neutron configures the networking aspects cinder provides block devices image u r i is looked up through glance
• 32:00 - 32:30 image is retrieved via swift and v m is rendered by a hypervisor so this is this in a overall that a brief ah overview of these of these hm open stack open source cloud so what will ah do next ah is ah a demo on this things i will try to give a live demo of our ah of our open stack installation at i i t kharagpur as I mentioned and then we will see that how
• 32:30 - 33:00 v m can be created and all those things thank you