zoom mysterious world

Cloud computing is on demand availability of computer system, especially storage and computing power, without direct active management by the user. People must be have an idea about computer we use in sense also we use some resources say hardisk network.

Why is it named as cloud computing?

It is not like we have anything in cloud. As all we know a cloud is formed with water vapour and we also know that cloud does not have any fixed structure, sometimes clouds forms and sometimes clouds dismantles. In same way the actual technology is made of no. of networks as well as users, sometimes users are not there and sometimes users are there. How cloud caters water molecules in the same way cloud computing in the whole world  provides services, it is not fixed for any particular user or company, its moment is not fixed, it runs all the times with these services.

In cloud computing what happens is computer persists in one place, which collects data from other places, in sense its data center must have spread in other places. Either that Data center is placed in other city or it may be in other country so what happens is it shares its resources either it may be the network or it may be the storage capacity for which data centre is used. In a small computer to store a data hardisk is placed inside it. But in big companies to store the data a hardisk is not at all sufficient. As because bulk data is stored for which they must be required big data centers.E.g. Facebook, Google these applications contain bulk data number of people have an account in google and facebook in more then 100’s and crores of GB. It seems that it cant be stored in one hardisk. For which company need number of hardisks, overall a data center.

 In Data center we had variety of units, hardisks, chambers overall we can say that the small towns with big data centers, Internet provider centers. An organization is established where need is tremendous now . As every organization cannot makes data centers if it does in such way then lower will be profit and heavy will be the expenditure. In such cases these companies ties up cloud computing, such a business like you people store our company data and in return deal with some monthly payment to the company.

So here different companies are there which handles the data as well as network. So in this case cloud computing stand by for all such companies. In a layman terms, our company data is saved or shared or the resources which are shared are distributed in terms.

Advantages:

For a company to fulfil its computing needs it need not to open any such data centers but can take from other organization. Eg: If you want to cook something at home then we had some options to satisfy our hunger, we can buy food in one of a good restaurant which seems less expenses whereas if you hire a professional chef and asks him or her to cook something  then it seems costly for you. Bust here you must have choice. It probably becomes costly if an organisation opens its own data center or network hub. Here you may have less limitations but more options of customization, but if we use other network centers then the expenditure may quite less. Compare to the loss limited use of customization. If company established in mumbai then its data center must be near to it as because organization have regular work on it.

Service:

The services of cloud computing is not only for storage e.g., Dropbox, Google drive, one drive etc. But it is more then a storage, no. of services  we get no. of applications moreover no. of companies are dependent upon a cloud. As if we know a company contains no. of data or software which they run etc. if company maintains all these by itself then it need a individual unit. If it deals with cloud service provider as a business where the servicer need to store data in exchange a monthly payment. In company to manage scale becomes little critical but in cloud if we need to scale up or down it can be easily provided as per company requirements.

Cloud computing is also a safe process. If suppose hardrive fails then there are chances to loose our data. In our computer but in cloud computing it is not stored in single drive that data can be lost. Even at home using the ID and Password can be opened we will get our data easily. This is one of the idea about cloud computing. Online gaming using cloud computing we can play high ended games with high internet speed. Photoshop, word, excel, PowerPoint also easily happens. Even if any kind of disaster takes place still the data is safe as because multiple copies are already be maintained using cloud computing services.     

What is Data Science ?

Data Science means on the basis of analyzing the data we take a marketing decision. Moreover we take analyzed data on behalf of which we took a decision. This is called as Data Science. In this way ,you can make this as an programming excel or use in any other platform.

Data Science is an inter-disciplinary field that uses scientific methods, process, algorithms and systems to extract knowledge and insights from many structural and unstructured data.

Concept of Data Science:

In Data Science we hear a lot about Artificial Intelligence and Machine Learning , which are going to change the world and how Internet of things will make everyone’s life easier. But what is the one thing that underpins of all these revolutionary technologies? The answer is Data from social media to IOT devices for generating inmeasurable amount of Data . Considering the cab service provider like Uber. As per current era we all must have used Uber. What you think about Uber is a multi-million dollar worth company? Is it that availability of cabs or Is it their service ? Well the answer is Data which makes them very rich, but wait Is Data enough to grow a business, obviously it isn’t we must know how to use Data to draw useful insights and solve problems. This is where Data Science comes in. In simple words Data Science is the process of using Data to find solutions or to predict outcomes for a statement with a problem better to understand Data Science. Data Science is related to Data Mining and Big Data.

Now in Data Science as we discussed earlier two things are more popular one is Artificial Intelligence and the second one is Machine Learning. Let us try to understand these concepts in brief.

You own a small company and people may have an idea to make CRM , so what will you do is you may hire someone  and tell him to collect Data on a regular basis. Basically while growing , we need to hack at least 5K – 6K Database to analyze it properly. Once you collect the number of account then you can easily make it on excel and the work will be done. But if you have a lot of Data ,  For e.g., you are trying to analyze Google’s  Data or trying to analyze the Data of that company which has over 100 branches and the daily Data of each branch is more than 1lakh. So Are we able to make it on excel sheet ? Assume that there will be many things which would work on monotonous basis. Such as first addition will be done then subtraction and the process will be going on. So here we do the same thing in programming instead of excel so it will be called as Data Scientist.

What is Machine Learning?

It means the machines are trying to learn how people behave. For e.g., I just said “Ok Google” so in many phones this instruction opened and on some phones it may not, so after that machine realized it didn’t open. Let me give proper explanation with another e.g., Whenever we chat on Whatsapp they ask us for rating. Some people rate 2 stars some 3 or 5 stars and some might be different. So on behalf of the Data they try to analyze the Data on a broader version. There are some various factors on which they try to analyze how was the connection, what was the device specifications such as its RAM, its Processing and many more. On excel we can consider maximum 2 or 3 factors and if we want to consider more than that we have to set up big software , that’s why the thing has been shifted to programming so we don’t need to spend money on complex software while analyzing the Big Data.

Students whoever knows well about statistics , they need to use statistics in order to analyzed bigger Data. Earlier when technology was not updated then statistics were used to analyze Data. This is the reason we are still learning about statistics. But now the software is launched on which we just put the statistics and answer will come up on the screen automatically. But suppose we need to make a thing for which no software is available so in that situation we will make our own code to execute the data of statistics.

Benefits:

Products will improve. People will give ratings to Whatsapp so in this way we can give Data to the machine, and doing business in this way(as discussed in above) ultimately the work will be improved. If there is a service industry as we know about the recent incident if a specific store is getting bad reviews , overall company can see that it is not going good. That’s the reason A big brand always ask you for filling a feedback form after using their services, whereas earlier the feedback form was used to fill manually on papers that’s why company hire people for Data entry. They just record the Data in excel sheet. But where all the Data go for compiling. Suppose there are 30 stores in vizag, in other states there would be one person whose duty is to collect Data of all the stores of Vizag and the same thing happens in the other states. There would be another person who will put all the files of different states together and then try to analyze Data in a broad term. He will try to figure out what people likes or dislikes. Are they comfortable with new products or not. People can’t even imagine how big the thing is. In every process Data Science is being used. It doesn’t matters you are selling a product on Amazon but we are discussing about a big companies but not small ones, only those companies who have big Database.

Data Science are used everywhere like if people want to improve their product service or even if their process. For e.g., you have a machine which manufactures something. So a person would be there who was assigned to check machine, he analyze and reports that where the machine actually lacks and how much time it takes to process and many other things.

A role of Data Scientist is analyzing the Data, and then takes a decision but not coding. Suppose we take a large Data and test it. For e.g., We show 2 types of advertisement to people.

One advertisement is related to Orange candy and other is related to Mango candy. Now there are many people who likes Mango candy. So we come to know people more prefer to Mango candy and after analyzing the Data we increase the manufacturing of Mango candy and decrease the manufacturing of Orange candy. So those are the works of Data Scientist. In beginning things won’t be like but observing overall a discipline forms. In future large scale companies will be working Data Driven approach. Whenever we go to a mall and many a times people offer a free sample of product and only ask us for our feedback form. They take our feedback and simply analyze Data and takes a relevant decision.  

Concept of Big Data:

Big Data means large collections of data. Big data is one of the latest technology . Earlier to this concept , mostly preferred technology is Data,  which is a traditional database.

In 1970, William Ford who designed this concept to overall database and Revolutionary Database management. Here data is stored in a structural form. The data which stored in Revolutionary Database Management system is mostly in structured form i.e, in tables . But in recent days mostly 90% of people prefer for unstructured data like in photos, videos, blogs, etc, where in videos we can find  videos only, in photos we can find photos only so the data will be in unstructured form with a huge varieties. Comparing the Big data with data, the data will be small so it named as Small Data and been said that earlier people use to follow Small Data but now era has been changed so far the technology as well as with the people too and now it’s a trend of Big Data.

What is Big Data ?

Before we learn about Big Data let us learn about what is data. Data is a collection of information. e.g., to know about some topic we collect information such as  if people are reading this blog or this blog related videos means they are collecting information about Big data. In Instagram if people post a picture i.e, also called as data or  guys if you share some images in Facebook that will also be called as data. So anything, digitally happens or digitally written i.e., known as Data. We have number of varieties  of Data. Simple kind of data that we can say as a video. Now lots of volume of Data if we mix i.e.,  called as Big Data. Big Data is nothing but large amount of complex data is simply said as Big Data.

What we do in Big Data?

Huge companies use process in this. My blog is simply a data, whereas the number of data used to be processed and the required information is filtered  for any purpose, so through this process company starts making benefit of this and use it in decision making.

Now we may ask How company uses Big Data in Decision Making ?

 People may heard that facebook leaks its data like in elections , people win through this Facebook website data how is it possible because in Big Data number of peoples Data is existed and through the Facebook we come to know the people’s  interest and sometimes shows that interest could also be changed. So whatever through this website tricks people usually wins elections . Moreover sometimes big companies had an urge of a printer yet the company not purchased any printers but still the printers are shown to the company so why is this happens means recollecting large amount of your company data, the needed data would be shown digitally through this way. In this way Big Data is used and processed.

We may not sample  but simply observe and track what happens. Big Data means a vast collection of Data , by  using this data company incurs the profit and also may use in Decision Making. As the previous years stored data of a  company is been collected and company usually checks which year  profits got maximized  and in which year they incur losses, what will be their decision when company earns profits, so all this based on analyzing which action should they take and which action they should not  , so that a company incurs  maximum profit. So what we can see here a Data how actually helps in Decision Making.

Usually , In Big Data a useful Data which we refine is known as processing and number of techniques we have like Data mining, Data Visualization,  Analysis, Search, Sharing, Querrying, Updating, Information privacy and Data source.

Types of Big Data:

Structured Data:

Structured Data is in a standard form. Everything will visible clearly  e.g., under name column the name would be mentioned, under the age column the age would be mentioned. Its just like in a tabular form. So no need of any hardwork here because  the Data is simply clear.

Unstructured Data:

Here Data is not clear, like we can see videos, audios, images, emails, all these are in unstructured pattern. No particular format is used and from this data we need to be refined. So this type of Data is called Unstructured Data.

Semistructured Data:

Structured Data + Unstructured Data = Semi Structured Data

In this different varieties of data are there the data may be like structured data and also in unstructured form like CSV file.

Characteristics of Big Data:

Big Data originally associated with three key concepts which is also known as 3V’s:

Variety:

In Big Data all kinds of varieties are available its not like any videos are available or any images are available but all types of data is available such as videos, audios, written content, text, Email, PDF, Excel, approximately all varieties of Data is available over here. Big Data represents varieties of Data.

Velocity:

In which rate of speed the Data is being processed like people upload Data or Retrieve Data how fast will be the processing time to take for all these steps.

Volume :

Volume means a large amount of data, means thousands/lakhs GB of Data then it is known as Big Data.

Therefore Big Data often includes Data with sizes that exceed capacity of traditional software to process within an acceptable terms. Current usage of this term i.e,  Big Data tends to refer use of Predictive Analysis or certain other advanced Data Analysis.

Introduction about Devops:

Devops is absolute need in every organization. It is latest buzzword in IT industry and it will remain that way until every organization out of their adopts. Devops or one of the variation of software world.

Devops apart from being Buzz word from internet it is coming from a clip compound words coming from two words.

                             Development + Operations = Devops

Let before we proceed about the problem in the statement Devop is trying to solve every need to understand what Devop is actually “NOT”

What is Devop?

Concept and How Devops work:

Devop is a concept i.e., used in the application Life cycle management and make sure that your development team is absolutely relaxed  and your operational team the team which handles all the servers all those amazing stuff are relaxed are working with the sink each other so that whatever the product or feature you want to give your end user you can do this with absolutely in smooth manner.

Now let us go to little deep that What is a big problem that Devops is trying to resolve:

Whenever the Application is being developed there are variety of phases of its development now when the Application is in small scale maybe designing a website or maybe designing a mobile apps then here is all good and happy because here ultimately manage everything you just design a website and maybe putting down in severs cloud whatever i.e., the features are very next day available the entire world to be used. The things actually changed whenever you work on big scale application say you tube, swiggy, zomato, flipkart, Amazon or may be any other part of these website. When these websites are being done we have variety of teams to mange parts the architecture of the applications putting it onto a midsize company usually there are two teams.

Team A:

Development

In this development team regards all developers such as Write code, Design new feature, Test Feature all these are on development so usually sometimes testers are also included in this team. Now this team designs a product checks out and says absolutely fine.

Team B:

Operations:

On the other team we have operations. The role of operations team is to manage all server configuration and not just only server configuration at couple of other things as well. These teams are responsible for managing such as application phases such as high traffic during the weekends, how they are going to manage then do we need to scale up, do we need to increase RAM over the servers or do we need to integrate any cloud server.

Now Team A Developers Team actually packs up the next update the features they want to roll out and sends it to the operations team.

Usually Developers team thinks that operations team have nothing more work to do and whenever they send such any updates they are going to deploy but what actually happens is operation team also gets busy in managing and checking a number of things including a scaleability, kind of traffics that getting, kinds of security as well. Usually in big applications these deployments happens in once in month or may be two times a month and only two time you can publish any code to the production level in sometimes creates a development team into frustration they did all. This creates a lag user doesn’t cares what’s happening what kind of fighting happens between development and production team.

 User always concentrates on new features as soon as possible or else competitor may release that faster than you. This exact problem can be solved through mindset a philosophy being used in Devops. In Devops the development team and the operation team doesn’t sit into completely different arena. They sit together they discuss side by side and even exchange the roles and responsibilities so that every person knows what happens in the operations and operation team know how teams work in development side as well. This exact mindset and philosophy that everybody knows what is happening in the development and what’s everything happening in operation side is called as Devops.

Infact the logo of the Devops is an Infinite cycle, the application development is infinite process it includes the variety of steps logo of Devops explains Devop pretty perfectly. Apart from this Devops also focus on lot of things into Automation as well. The more things are automated the more things are going to be free.

 Infact interact people and lots of things and tools as well are here to understand. Now if a Person says Devops also have tools like Peppet, Jenkins, code editors etc. Since application development  to be reaching truly to the users these all tools are to be used. Its not about learning any essential tool in all this Devops is all about minset moreover understanding in every phase of development cycle and understanding what happening on the other wall.

What is Block Chain?

Blockchain is a technology where Bitcoin or other services are transferred from one individual to other individual successfully.

Bitcoin is a type of digital currency where record of transactions are maintained and new units of currency are generated by computational solution of mathematical problems also it operates individually to central bank.

Example:

If Person A need to send money to person B who resides in London, obviously Person A needs a help of a trusted third party e.g. Bank/Western Union etc, in this process it may takes nearly (1-3)days along with some extra charges. But using Blockchain technology this amount can be send to anyone or to anywhere who resides wherever in the world, it takes in minutes and transaction fees is less compared to Third Party charges.

Simply say with the help of mobile phones we can talk directly to our friends but through the same mobile if you want to buy something then you need a Third person who guarantees the seller that an amount has been credited. But is it Possible that buyer and seller would have an understanding without any Third Party. Blockchain is the technology which makes such transaction possible.

Block chain is a distributive database where data is stored in 100’s or 1,00,000’s of computers. Here data is encrypted and recorded in private basis.

Invention

Block chain is invented in 2008 S.Nakamoto(Pseudonym) invented this from Bitcoin service, to serve as public transaction  ledger of crptocurrency bitcoin.

Blockchain Technology

Block chain is such technology which acts a medium to send money to anyone wherever he may reside, without any help of banking sector. Block chain is started because of Bitcoin but new services are also joined through Block chain. It is an open ledger, where for any network the people who were connected with the network  knows well, who is the payer and payee and how much is to be paid. So no chances to tamper. And in that network everyone eventually can decide either the network is valid or not.  If any transaction is made then no worries that transaction would highly recorded in 1000’s of computers.

Another important thing that we would mention hacking a Block chain is not even an easy task because to do this hackers need to hack 1000’s of computer at a time which is highly equal to impossible so it is a safe technology.

Block chain is first used in 2008 when digital coin bitcoin is invented. Bitcoin is a decentralized cryptocurrency which is not under any bank or any country as mentioned above. The use of Block chain has been started through cryptocurrency but its use slowly been trying by government and public sector. E.g. Government or legal paper which has been used through a public register is a proof that for this property an owner is hereto. But now there is a vast scope of placing Block chain instead of public register in future because document registered in Block chain is as much as valuable in Public register.

Block chain if becomes becomes Public Register no chances of fraud to occur, Block chain is safe technology where even the stored data could not be erased, e.g., if incase a computer RAM or Hardisk got damaged it may not work but in Block chain 1,00,000’s of computers are working under this 1,2 or 100’s of computers even if are damaged still transaction is continued. Today in Block chain cryptocurrencies has been used in coming days banking sector would work on this because it is easy and safe. In Block chain every computer system history is recorded and been stored and the data is totally private where to enter a new partner need an approval of particular network partners. For any digital information makes safe and secure Block chain has been used each and every department would adopt Block chain technology either it may be university or passport services if it would be recorded on Block chain then Zero chances to hack by hackers.

As Per Government Schemes Poor people need help or students scholarship or any natural calamity victim then through Block chain technology amount will directly reach to people through phones. Through this corruption chances due to Third Party may not occur at all and the victim or person would would receive total amount.

Working of Block Chain Technology:

Let me explain through some Illustration:

Illustration 1: Assume Girl 1 who is innocent enjoyed her Trip in London with great experience and a huge shopping like jewels and dresses,etc. and returned India and shared her experiences with Girl 2 all about her shopping in London. This Girl 2 is cunning and clever she conveyed the same content with bit changes to Girl 3 that Girl 1 went to Kolkata and had a great experience and shoppings too. Now Girl 3 is little more clever then Girl 2 she coveyed the same content with bit more change that Girl 1 went went to local shop and bought all those in cheaper malls. Now what was the Actual content that Girl 1 went to London and had a great experience and shopping but what content coveyed to last Girl 4 that she went to some local shops and bought all those in cheaper malls. Here what we can see is content started something but till it reaches to last person content has totally been changed. The information how its been originated should reach in the same prospect to last person.

Let’s come to objective

So Replacing information let us use Bitcoins as Per Block chain.

Girl 1 Transaction à                       Girl 2 Transaction à             Girl 3 Transaction  

This should be the original transaction where girl 1 paid 10 Bitcoins and so as Girl 2 pay 10 bitcoins to Girl 3, but if incase Girl 1 pay 10 bitcoins to Girl 2 and as Girl 2   is clever and only pay 5 bitcoins to Girl 3 then the transaction becomes invalid become the propect is show clear that errors could be clearly visible.

This concept actually originated in 1991 but started using in 2008, now its been a famous when Bitcoin became popular. Now how Bitcoin works.

Transaction 1 à                            Transaction 2 à                  Transaction 3

Note: Hash means any transaction finger print or you can say a digital signature or a thumbprint.  Previous hash means in earlier if me make a transaction then it stores

If Instead of 10 Bitcoins I change 5 Bitcoins the Fingerprint changes. If any small thing I try to change then automatically finger print changes. It means for a particular transaction only this is the unique finger print.

Previous Hash will be hash of transaction 1 now e.g., if transaction we change B paid C as 5 Bitcoins then what happens the hash in transaction 1 changes as ACHKL021 which completely mismatches. It indicates that the Block chain is tampered/hacked/fraud so is not valid. Coming to 3^rd transaction the previous hash would be the hash of 2^nd transaction (so as applicable in transaction 1&2).

Through this table what we can completely understand is how the data originated will reach to the last person in same sense.

Now coming to hack this data let us hack then let me change the Bitcoin and also the hash transaction 1, also let us change hash and Previous hash in same as Transaction 2 and 3 also.

Note:

Proofs of Block chain Concept :

 1. It takes approximately 10minutes to generate one hash valueàIt keeps on getting tougher and tougher.

 2. Multiple copies of chain are maintained

1. It takes approximately 10minutes to generate one hash valueàIt keeps on getting tougher and tougher.

If I would generate a finger print either in A to B transaction or hash value then I would mention that it takes 10 minutes to generate a finger print. Now how big the chain is, it takes such time either it may be 10minutes/15 minutes/20 minutes, now such transaction takes place in crores. To change only a hash value it takes 10minutes now think that to change values/transaction/fingerprint.. how much time will it take 10minutes * 1 change = 1crore minutes nearly it takes 2years.

2. Multiple copies of chain are maintained.

Now we heard that Bitcoin is a distributive network not a central depository which is a main single ledger and keep going on. It is a Peer to peer network/distributed network whoever wants to generate crypto currency they must have copy of this ledger.

 Person 1:

Person 2:

Person 3:

 These are the multiple copies where every person in the network carries a copy of transaction, Now assume that the 2^nd person seems little clever and changed the hash as given below

Person 2:

Now comparing Person 2 copy with Person 1 & 3 Person 2 transaction appears little different, it means fraud has been happened in this case. So Bitcoin Block chain eliminates 2^nd transaction as it is an invalid transaction and copy the correct transaction and enter such transaction in Person 2 database. This is how Block chain works. To develop our country a proper technology should be adopted.