UNIT-2 Emerging Technologies
UNIT-2 Emerging Technologies
Big data: refers to large and complex datasets that traditional data
Today, data comes in an array of forms such as emails, PDFs, photos, videos,
audio, social media posts, and others.
Variety is one of the important characteristics of Bigdata.
Cont…
Structured Data:
Refers to data that is organized and formatted in a specific way, typically
stored in databases or spreadsheets.
Unstructured Data:
Refers to data that does not have a specific format or organization. It includes
text documents, images, videos, social media posts, etc.
Semi-Structured Data:
Refers to data that has some structure but does not fit into a traditional
relational database model. It may have tags, labels, or attributes that
provide some organization, but the overall structure is not as rigid as
structured data.
Metadata
Cont…
Velocity: Velocity refers to the speed at which data is being created in real
time.
Volume: Volume indicates huge ‘volumes’ of data that are being generated
daily from various sources, like social media platforms, business processes,
machines, networks, human interactions, and others.
Value: Value is the other major issue that we need to concentrate on. It is not
just the amount of data that we store or process.
Cont…
Big data focuses to find an alternatives way to filter the huge unstructured data
to use in business developments.
2.1.2 Benefits of Big data
Customer acquisition and retention: Consumer data can help the
marketing efforts of companies, which can act on trends to increase customer
satisfaction.
For example, personalization engines for Amazon, Netflix, and can provide
improved customer experiences and create customer loyalty.
Targeted advertisements (Ads): Personalization data from sources such as
past purchases, interaction patterns.
Product development: it allows you to update existing products/services
while innovating new ones..
Price optimization: This minimizes the manual work and reduces the
possibility of any man-made errors.
Cont…
Risk management: Big data analytics can identify new risks from data
patterns for effective risk management strategies.
Improved decision-making: Insights of business users that are extracted
from relevant data can help organizations make quicker and better decisions.
2.1.3 Application of Big data
What is Application ?
Retail – Big data has changed the way traditional retail industry. works. Over
the years, retailers have collected a vast amount of data from local
demographic surveys, Point of Sale (PoS), scanners, customer cards, and store
inventory.
Now they have started to use this data to create personalized customer
experiences, boost sales, increase revenue, and deliver improved customer
service
Application of Big data
Application of Big data
Transportation : The transportation business can also benefit greatly from Big
data analytics.
Both companies and government-run transportation corporations employ Big
data technologies to optimize route planning, control traffic, manage road
congestion, and improve services in countries all over the world.
Application of Big data
2.1.4 Challenges of Big data
Aside from the benefits, Big data also has challenges related to data quality,
storage, a shortage of data science experts, validating data, and gathering data
from various sources.
Even though the challenges of Big data and other similar emerging technologies
will change over time due to the dynamic and frequent advancement of those
technologies.
Managing Big data Growth-
One of the main issues with Big data is how to properly store these large amounts
of data.
Data centers and databases used by businesses are constantly storing more data.
Big data sets grow quickly over time, making management of them more difficult.
2.1.4 Challenges of Big data
Lack of data professionals-
Companies demand skilled data specialists to manage Big data solutions.
These experts consist of data scientists, data analysts, and data engineers who
are skilled at using the tools to manage huge data sets.
Securing Data
One of the major difficulties of Big data is keeping these enormous
sets of data secure.
Companies frequently put data security to later phases because they
are so busy in understanding, storing, and analyzing their data sets.
2.1.4 Challenges of Big data
Integrating data from a variety of sources-
Data is obtained from different sources in a business and operations.
This includes social media pages, company wide software products, customer
log files, financial transaction data, email communications, presentations, and
reports by employees.
It require to determine which data is most relevant and focus on that to save
organization time and money.
2.2. Cloud Computing
What is cloud ?
What is Computing?
"The cloud" refers to servers that are accessed over the Internet, and the
software and databases that run on those servers.
Cloud servers are located in data centers all over the world.
Computing includes designing and building hardware and software systems
for a wide range of purposes; processing, structuring, and managing various
kinds of information; doing scientific studies using computers; making
computer systems behave intelligently; creating and using communications and
entertainment media;
Cont…
Cloud computing : is defined as storing and accessing data and computing
services over the Internet. It does not store any data on your personal computer.
Computing services like servers, data storage, networking, databases, etc.
are all available on-demand.
The main advantage of cloud computing is it gives access to many users from
single data center which allows users to store and access their data over the
internet without any limitations.
Peoples are using different types of cloud-based services for their email
communications, document management, entertainment and ecommerce
services.
Cont…
Cont…
Examples of cloud-based services includes but not limited to:
Gmail
Google Maps
Amazon
Netflix
PayPal
Spotify
Adobe Creative Cloud
Kindle etc
2.2.2 Benefits of Cloud Computing
Accessibility and mobility: Users may access their tools from anywhere, at
any time, and from any type of devices as long as they are connected to the
Internet, which is one of the most significant benefits of the Cloud.
This greatly helps the implementation of inclusive education which is schools
for everybody through support learning and respond to individual needs.
Cloud based services support to include inclusive technologies like voice
recognition, mind mapping, word prediction, text to speech for editing etc.
Flexibility- Services become entirely adaptable and can be changed at any
time to meet users’ needs and commercial requirements.
User can restrict or enhance the available resources while paying only for
what is used.
Cont…
Cont…
Another benefit is that resources can be shared, allowing users to collaborate
in real-time on the same content in all domain and work environments.
Updating and scalability: The service provider, as well as taking care of
maintenance, takes care of all service updates, which allow users to focus more
effectively on our work and responsibilities while increasing our efficiency.
Optimized security- When compared to traditional and internal
infrastructures, Cloud Computing provides enhanced security.
Companies are finding it increasingly difficult to effectively secure their own
IT systems due to a lack of time, expertise, and budget.
Cont…
Cont…
Control led costs- The other advantage is that Cloud Computing allows for
greater control of costs IT infrastructure.
We can adjust the resources allocated to its infrastructure depending on its
needs by increasing or decreasing the resources available. By subscribing to
Cloud Computing services, users or companies pay only for what they used
(Pay as you go model).
2.2.3 Limitations of Cloud Computing
Server downtime: – No cloud provider can guarantee that you will not have
service interruptions.
which will prevent you from accessing your data or files. Because cloud
computing is dependent on an Internet connection, if it goes down, so will your
cloud services.
Security and privacy issues: – When it comes to handling sensitive data,
companies are always concerned about how safe and private it is.
There is still a risk of intruders, even though a cloud provider would have
security processes in place to ensure that your data is maintained and protected
properly.
Cont…
Data ownership and transparency : Companies may think that there is a
lack of transparency concerning data ownership.
Another concern is lack of data openness. Companies may be concerned about
how their data is managed and whether it is being compromised or not.
Inflexibility : Some cloud computing providers may take a corporation off
guard by requiring the usage of their applications and formats.
For example, they can limit that a corporation can only upload data developed
in a specific application program.
Because the cloud provider has complete control over your cloud service
infrastructure, they have ultimate authority over how your data is handled
Cont…
Lack of support – Cloud-based services, in comparison to other hosting
services and providers, provide minimal to no customer assistance.
Customers who are unable to contact cloud providers by phone or email
frequently turn to Internet forums for answers to their questions.
Cost: – Another disadvantage of this service is the unknown fees.
Although cloud hosting eliminates the need for on-site infrastructure, it is
often necessary to ensure that you are paying for all of the features that your
organization needs to get the most out of the service.
2.2.4 Types of Cloud Computing
There are mainly four types of cloud computing available currently, namely:
Public cloud – It is a standard cloud computing model where a service
provider’s resources are shared across different clients.
For example, if you rent 10GB of public cloud storage, you will get the
requested capacity of a disk from a bigger chunk of a single storage device that
is logically divided into small parts and distributed to multiple users isolated to
make it private across different clients.
Public cloud
Advantages:
• Low Cost
• No need to purchase hardware or software and you pay only for the service you use.
• No Maintenance
• The Cloud provider is responsible for the maintenance of the hardware, software, and networks in
the cloud
Can be access from anywhere
Low cost and zero hardware maintenance
Pay As per Use Model
• High Scalable
Disadvantages:
• Less Customizable
• Less security
Cont…
cont…
Private cloud – As the name indicates, the private cloud has all resources
dedicated to your application.
It can be either from a cloud service provider or your company’s data center.
Benefits:
Non-critical tasks such as development and test workloads can be done using
public cloud whereas critical tasks that are sensitive such as organization data
handling are done using a private cloud.
Benefits of both deployment models, as well as a community deployment
model, are possible in a hybrid cloud hosting.
Cont…
Community cloud – It is a collaborative, multi-tenant platform used by
several distinct organizations to share the same applications.
The users are typically operating within the same industry or field and share
common concerns in terms of security, compliance, and performance.
Community cloud
Advantages:
Cost Effective
Community cloud is cost effective because the whole cloud is shared between
several organizations
Flexible and Scalable
The community cloud is flexible and scalable because it is compatible with
every user.
It allows the users to modify the documents as per their needs and requirement.
Security
Community Cloud is more secure as compare to Public cloud but less secure as
compare to Private Cloud.
Cont…
Disadvantages:
Community Cloud is costly than the public cloud.
Community cloud is not a good choice for every organization.
The fixed amount of data storage and bandwidth is shared among all
community members.
Cont…
What is Internet ?
Internet is a global network or of billon of computers and other electronic devices.
The Internet was created in the late 1990s and is now more than 30 years old, with
over 2 billion people using computers, cell phones, and tablets to access it.
As per the definition of Oracle.com, Internet of Things (IoT) is a network of physical
objects or people referred to as “things” that are equipped with software, electronics,
networks, and sensors to collect and exchange data.
The term has recently been added to the Oxford dictionary and is defined as: “The
interconnection via the Internet of computing devices embedded in everyday objects,
enabling them to send and receive data.”
Cont…
Cont…
IoT aims at extending Internet connectivity beyond computers and
smartphones to other devices people use at home, or for business.
The technology allows devices to be controlled across a network infrastructure
remotely IoT aims at extending Internet connectivity beyond computers and
smartphones to other devices people use at home, or for business.
The technology allows devices to be controlled across a network infrastructure
remotely.
As a result, it cuts down human effort and paves the way for accessing
connected devices easily.
IoT makes things virtually smart through Artificial Intelligence algorithms,
data collection, and networks to enhance our lives.
Cont…
2.4.1 Major advantages of IoT
Efficiency- We can gather trustworthy and secure real-time data thanks to IoT,
and we can then translate it into really useful information for enterprises.
This helps to reduce the consumption of resources to improve our efficiency
and productivity. For example, if you want to find the answer to a question,
instead of browsing on your phone or turning your computer on, you can just
ask a voice assistant such as Siri, Alexa, Google Home, Cortana, and more.
Technical optimization- You no longer have to operate multiple devices for
each task manually if you use an IoT system because it allows you to control
everything using a single device like your smartphone. You can easily control
Television (TV) volumes, thermostats, and dim your lights, etc
Convenience- IoT can provide quick and quality solution by improving
customer experience.
2.4.1 Major advantages of IoT
Improved customer experience- As you can offer your targeted customers
what they need, you can understand their pain points, and provide quick and
quality solutions. This improves the customer experience.
Conservation- IoT helps to conserve the environment by monitoring traffic,
water/ electricity usage, air quality, etc. Smart cities are developing and it also
assists city planners and residents in finding solutions to problems.
Personalization- As IoT devices can collect your data, they can learn your
preferences, likes, and dislikes quickly. As a result, they trigger more
personalized services based on your choices.
Some Limitations of IoT
Security and privacy - IoT devices are evolving and becoming more widely
used, making it difficult to keep the data they collect and transmit secure.
IoT devices are being used in more sensitive industries, like healthcare and
banking, which raises concerns about data protection.
Global information privacy regulations are also becoming effective, so
protecting data is not only beneficial from a commercial standpoint but is also
required by law.
Connectivity and power dependence - For many devices to operate
successfully, the internet and constant power are required. When either goes
down, everything connected to it and the device also do.
Some Limitations of IoT
Complexity and Integration - IoT is an advanced technology whose design is
quite complicated. Plus, maintenance and deployment are also not easy for
some IoT solution.
IoT protocols and standards are still subject to discussion, therefore devices
made by various manufacturers may not be compatible with current hardware.
It may be challenging to integrate effectively because each one may need
various hardware connections and setups.
Higher Cost - IoT device deployment frequently requires a significant time
and financial investment. There are numerous devices that need to be
purchased, setup, and installed by professionals. This causes a subsequent
exponential increase in cost.
2.4.2 How Does IoT Work?
A complete IoT system integrates four component.
Sensors/devices- First, sensors or devices collect data from their
environment. Multiple sensors can be bundled together or sensors can be part of a
device that does more than just sense things.
For example, smart mobile phone is a device that may have multiple sensors
(camera, accelerometer, etc.), but your phone is not just a sensor. There are
plenty of sensor types which can be used based on the purpose.
Examples includes temperature sensors, proximity sensors, humidity
sensors, smoke sensors, water quality sensors, infrared sensors, motion
sensors etc.
Cont…
.
Cont…
to the cloud. This could be very simple, like making sure the temperature
computer vision to detect things in the video (like intruders in your house).
User Interface- Next, the information is made available to the end-user
For example, the user might remotely adjust the temperature in the cloud storage
via an app on their phone, and some actions are performed automatically.
Rather than waiting for you to adjust the temperature, the system could do it
automatically via predefined rules. It instead of calling you to alert you of an
intruder, the IoT system could also automatically notify relevant authorities or
agencies as per the prior configuration.
2.4.3 Application of Internet of Things
Technology-based innovations like IoT are going to have a vital role in areas
such as healthcare, economy, marketing, finance and banking, and government
sectors. It uses advanced levels of automation, connectivity, and customization.
Smart Home- Smoke detector, light bulbs, appliances, door and window
locks, pet monitoring camera, smart thermostat.
Cont…
Cont…
Smart City-Traffic Management, Waste management, and Water Distribution.
Cont…