Quick Summary of AWS Summit New York – 2019

During AWS Summit New York – 2019 AWS announced many new services, launched existing services in new region and added new features in existing services. Personally, I liked Event Bridge and CloudWatch Container insights. Below are  highlights of these services

Introducing Amazon EventBridge

Amazon EventBridge is a serverless event bus that makes it easy to connect applications together using data from your own applications, Software-as-a-Service (SaaS) applications, and AWS services. EventBridge delivers a stream of real-time data from event sources, such Zendesk, Datadog, or Pagerduty, and routes that data to targets like AWS Lambda.

You can set up routing rules to determine where to send your data to build application architectures that react in real time to all of your data sources. EventBridge allows you to build event-driven architectures, which are loosely coupled and distributed. This improves developer agility as well as application resiliency. EventBridge makes it easy to build event-driven applications because it takes care of event ingestion and delivery, security, authorization, and error-handling for you.

 EventBridge leverages the CloudWatch Events API, so CloudWatch Events users can access their existing default bus, rules, and events in the new EventBridge console, as well as in the CloudWatch Events console.

Introducing Amazon CloudWatch Container Insights for Amazon ECS and AWS Fargate - Now in Preview

Amazon CloudWatch Container Insights is now available in preview to monitor, isolate, and diagnose your containerized applications and microservices environments. With this preview, DevOps and systems engineers have access to automated dashboards summarizing the performance and health of their Amazon Elastic Container Service (ECS) and AWS Fargate clusters by tasks, containers, and services.  

Optimize Cost with Amazon EFS Infrequent Access Lifecycle Management (Cost Optimization)

You can now choose from four Amazon Elastic File System (Amazon EFS) Lifecycle Management policies to automatically move files into the EFS Infrequent Access (EFS IA) storage class and save up to 85% as your access patterns change. Additionally, you can now enable Lifecycle Management for all EFS file systems. 

AWS Elemental MediaLive Now Supports AWS CloudFormation (Good feature for Media domain)

You can now use AWS CloudFormation templates to create and configure AWS Elemental MediaLive channels (both inputs and outputs). This improvement enables you to use AWS CloudFormation to deploy MediaLive resources in a secure, efficient, and repeatable way.

Note: Reference has been taken from aws.amazon.com

Next Generation Order Placing System

The world is changing fast; e-commerce battle has been expanded from PC to mobile.

Still the way we order much more similar to what we do before 5 years…But it times to change this system.

I am working in proto type and also designing how next generation system looks like. In this article I will discuss about three points

 1) New Order Placing system which just arrived

 2) Possible Order placing  System  #1 (very general to order anything and fits in your garbage)

 3) Possible Oder placing system #2 (built in system sensor with your product package or in your jar)

1)      New Order Placing system which just arrived - Amazon dash

How it works?

·         If you think that 5 items are there which you never want to run out then you can buy those dash button for these five items.

·         Whenever you notice that your favorite items about to run out press that dash button and it will send order details.

·         You will get mobile notification and if you want you can edit the order as well

·         If you are prime member then within two days those item will be at your door steps

Disadvantage:

·         Very limited options to buy different dash button and it cost (4.99$)

·         You are bounded to only one portal and one product

2)      But I am more interested in developing prototype for option #2 and that system will be intelligent enough to read the barcode and order the same price after compering total prices , ship time (based on your priority )

How it will work actually?

·         A Sensor install into or an intelligent garbage collector  which is connected to wifi and also connected to main server

·         You can login into the portal and customize your priority and also configure order quantity for particular item

·         You through your empty package into garbage ..sensor will read barcode.

·         Sensor then send this information to server

·         Server will search certain portals and try to find best deal

·         Order that item and send you the notification

·         If you feel that you want to modify order just click on the link and modify order

Disadvantage:

·         Difficult to order very large item which you cannot throw in garbage

  

3)      Third option is to develop sensor and programmed it to send signals when jar is about to empty

How it will work actually?

·         Buy N number of wifi enabled sensors

·         Associate order with each sensors (the way dash is doing)

·         Set threshold weight

·         Put that sensor in Jar

·         Now when jar is have less weight which was specified in the threshold level of sensor

·         Sensor will send signal to particular device which is in the home and that device will send that signal to Main server

·         Server will compare market prices and place the order

·         Consumer can edit the order

Disadvantage:

·         Lots of manual work to setup and customize sensor

·         What if you cook the sensor (you are putting sugar in tea and you boiled out that sensor and more you may drunk  it as well J)

 

Feel free to drop your ideas in comment and if you have any suggestion or need more information then feel free to contact me on viralpala@gmail.com

Hope you like this article!!!

AWS New Services

In the last week during Amazon re:Invent 2015 Las Vegas, Amazon has announced some new services  below are quick view of of these services and more details are on the way !!!

Amazon QuickSight:

Fast, easy-to-use, cloud-powered business intelligence

 Amazon Kinesis Firehose:

Easily load streaming data to AWS

 

AWS Import/Export Snowball:  

Transfer 1 Petabyte Per Week Using Amazon-Owned Storage Appliances

AWS Config Rules (Preview)

AWS Config Rules is a new set of cloud governance capabilities that allow IT Administrators to define guidelines for provisioning and configuring AWS resources and then continuously monitor compliance with those guidelines. AWS Config Rules lets you choose from a set of pre-built rules based on common AWS best practices or custom rules that you define

Amazon Inspector (Preview)

Amazon Inspector is an automated security assessment service that helps improve the security and compliance of applications deployed on AWS. Amazon Inspector automatically assesses applications for vulnerabilities or deviations from best practices. After performing an assessment, Amazon Inspector produces a detailed report with prioritized steps for remediation

How to Convert IT from Cost to Value

How to Convert IT from Cost to Value

Now days each big organization have many divisions and those divisions are eating cost and because of this IT looks like a Cost not profit center to higher management.

Also Higher management does not able to find out which department eating IT most and when it comes to different public cloud , private cloud and hybrid cloud it becomes very difficult.
and to solve this problem we need to focus on   TBM (Technology Business Management)

I am just describing approach to achieve this 

1)  First you need to collect data on who is eating your services.

2) Then you need to collect data and prepare inventory of all the hardware , software and network (including Service provider )

3) Collect vendor information a 

4) Now once you have this data you need to use tool which allow you to see unified view across all the the infrastructure (like cloud cruiser )

5)  once you have this kind of tools ..it will provide you data about which business unit is consuming your service.

6) now you can use chargeback and show back to relaize that business unit that they are consuming services

7) for private cloud you can use cost model from Apptio and from other to determine exact cost of the VMs and other hardware (including space ) and based on that you can chargeback - showback to your division

8) once you have trend data and capacity picture then you can optmize your cost

9) some tools allow you to do What-If modeling which empower you to compare with diffrent public/private and hybrid model.

once you start forecasting , chargeback-showback and invoices , you will cameto know from where we can cut the cost and at what level.

This will reduce your cost by 20-30% and most it will help higher management to take decision 

For create your next IT cloud strategy feel free to contact me on viralpala@gmail.com may be I can guide you to save the cost and help you to design your Enterprise cloud migration .

Thanks 

Viral Pala , PMP

viralpala@gmail.com

AppStore has been compromised and over 85 apps

AppStore has been compromised and over 85 apps have been discovered to be infected with malware. The compromised iOS apps include IMs, banking apps, mobile carrier’s app, maps, stock trading apps, SNS apps, and games.
 

More stories: http://bgr.com/2015/09/21/app-store-hack-iphone-malware-apps-list/
http://securityaffairs.co/wordpress/40318/security/apple-app-store-attack.html
http://blog.trendmicro.com/trendlabs-security-intelligence/the-xcodeghost-plague-how-did-it-happen/
http://www.net-security.org/malware_news.php?id=3109
http://www.scmagazine.com/apple-app-store-stored-hundreds-of-malicious-apps/article/439845/

The current list of 85 known compromised apps that contain the malware “XcodeGhost” is below.

If any of these apps are on your iPhone or iPad right now, uninstall them asap.
If you need assistance, contact Client Services.

air2
AmHexinForPad
Angry Birds 2
baba
BiaoQingBao
CamCard
CamScanner
CamScanner Lite
CamScanner Pro
Card Safe
China Unicom Mobile Office
ChinaUnicom3.x
CITIC Bank move card space
CSMBP-AppStore
CuteCUT
DataMonitor
Didi Chuxing
Eyes Wide
FlappyCircle
Flush
Freedom Battle
golfsense
golfsensehd
guaji_gangtai en
Guitar Master
High German map
Himalayan
Hot stock market
I called MT
I called MT 2
IFlyTek input
IHexin
immtdchs
InstaFollower
installer
iOBD2
iVMS-4500
Jane book
jin
Lazy weekend
Lifesmart
Mara Mara
Marital bed
Medicine to force
Mercury
Micro Channel
Microblogging camera
MobileTicket
MoreLikers2
MSL070
MSL108
Musical.ly
NetEase
nice dev
OPlayer
OPlayer Lite
PDFReader
PDFReader Free
Perfect365
Pocket billing
PocketScanner
Poor tour
Quick asked the doctor
Quick Save
QYER
Railway 12306
SaveSnap
SegmentFault
snapgrab copy
Stocks open class
SuperJewelsQuest2
Telephone attribution assistant
The driver drops
The Kitchen
Three new board
ting
TinyDeal.com
Wallpapers10000
Watercress reading
WeChat
WeLoop
WhiteTile
WinZip
WinZip Sector
WinZip Standard

Amazon AWS EFS (Elastic File System)

So finally wait is over, Amazon unfold this in San Francisco, CA seminar.

So what is Amazon EFS (Elastic File System) ?

It’s new generation storage for the Amazon cloud lover (like me!!!)

• Fully managed File System for EC2
• Grows to petabyte scale , elastically (No need for pre-reserve , pay as you use)
• It’s SSD based (Solid State Based) , so very low latency and high through
• Highly available and durable
• Automatically data replication across available zones (AZs) (Same way S3 do)
• Support NFSv4

Not only has that still there are some other features as well

• Throughout and IOPS scale automatically
• Support for thousands of concurrent NFS connections
• Consistent Low latency access.

Still it's in Preview but I am hoping by next winter they will launch full fledged service.

If you need more information feel free to email me on viralpala@gmail.com or if you have any other information please post that in comment section so all can share the knowledge !

Continuous Integration (Part 1 )

Continuous Integration   (Part 1 )

What is Continuous Integration   ?

Continuous Integration is software development practice where members of a team integrate their work frequently, usually each person integrate at least daily – leading to multiple integration per day. Each verification is verified by an automated build (including test) to detect integration errors as quickly as possible.

How exactly it’s different from normal build?

In our normal build.

1. 1)      Developer changes the code to develop new feature or may be it fix the open bug.
2. 2)      They do unit testing (or not do J )
3. 3)      They commit their code.
4. 4)      Everyone who pull the code
5. 5)      And if code has error every one get hit of the bad or buggy code.

May be even if developer do the unit testing there is possibility that that code failed in integration testing.

Also there is a chance of manual error while deploying code on client side.

Solution of this problem is Continuous Integration !!!!  (More in Part II)

I explain current deployment and problem with below images 

1) Normal Team where two different component build by two different team members.   

2) When One team member test hi code and commit.

3) When second team member get code and it break his/her whole system :-(

So please refer my Continuous Integration (Part II )

WebPage Performance :: Monitor and optimization

Monitor Page Performance Monitor and optimization

I was developing site and think how to monitor and increase the performance. After discussing with some subject matter expert and with my QA friend (yes I am developer than also QA is my friend :- ) )

I found couple of ways to test the page performance. That I would like to share with you.

There are mainly three good tools to test this (as far as I know)

        1)      https://developers.google.com/speed/pagespeed/insights/

        2)      http://tools.pingdom.com/fpt/

        3)      http://gtmetrix.com/

Each one give us the great result, personally I like #1 google and #2 PingDom.

PingDom

Pingdom major the performance using  water fall mechanisam and provide the details.

Google

                Google analyze the page , do the load performance and give you result along with suggestion, It also give result for Mobile version as well.When I analyze the data for various website with google developer tool.

 I found that Java script, CSS can also increase the loading speed , also image is very crucial part if we use image cleverly than performance can be increase significantly    

Below are one snap shot of Google Developer tool for page speed.

As always your suggestions are welcome and you can write your feedback in below comment or you can email me on viralpala@gmail.com

Performance Tuning : SQL Server Part -1

Performance Tuning : SQL Server Part -1

I always prefer to create index many does not agree but I believe this is the step where you don’t need to build no deployment and no code change , so why should we not try ?

There are two type of Index basic index and one more hybrid

           1)      Cluster Index

           2)      Non Cluster index

               *      covering indexes (may be New but interesting)

So first look into each and every table and create Primary Key, because primary key will automatically create cluster index and “select “execution will become fast

Create non-clustered indexes on columns which are:

• ·         Used to join other tables
• ·         Frequently used in the search criteria
• ·         Used in the ORDER BY clause
• ·         Used as foreign key fields
• ·         Of having high selectivity (column which returns a low percentage (0-5%) of rows from a total number of rows on a particular value)
• ·         Of type XML (primary and secondary indexes need to be created; more on this in the coming articles)

Now what if you want to search employee with his name and designation + LocationFortunately, there is a way to implement this feature. This is what is called "covered index". You create "covered indexes" in table columns to specify what additional column values the index page should store along with the clustered index key values (primary keys). Following is an example of creating a covered index

CREATE INDEX NCLIX_Employer_EmpID--Index name

ON dbo.EmpMaster(EmpName)--Column on which index is to be created

INCLUDE(EmpDes, EmpLoc)--Additional column values to include

Now you created Index but what if it gives you performance in Test environment not in production ?

You will thought is it possible ? Yes it is possible because Sql engine generate different query plan based on

• ·         Volume of Data
• ·         Index variance
• ·         Parameter Value in SQL SP
• ·         Load

So is there any way to create same environment as production???

Yes…  

That’s call Database Tuning Advisor’s Help with Profiler.

1.       Use SQL Profiler to capture traces in the production server. Use the Tuning template (I know, it is advised not to use SQL Profiler in a production database, but sometimes you have to use it while diagnosing performance problems in production). If you are not familiar with this tool, or if you need to learn more about profiling and tracing using SQL Profiler, read http://msdn.microsoft.com/en-us/library/ms181091.aspx.

2.       Use the trace file generated in the previous step to create a similar load in the test database server using the Database Tuning Advisor. Ask the Tuning Advisor to give some advice (index creation advice in most cases). You are most likely to get good realistic (index creation) advice from the Tuning Advisor (because the Tuning Advisor loads the test database with the trace generated from the production database and then tried to generate the best possible indexing suggestion). Using the Tuning Advisor tool, you can also create the indexes that it suggests. If you are not familiar with the Tuning Advisor tool, or if you need to learn more about using the Tuning Advisor, read http://msdn.microsoft.com/en-us/library/ms166575.aspx.

R   Reference : One article in Tech general and by some R & D

y   

      you can write feedback on viralpala@gmail.com. 

Save Millions of Dollars By Windows Azure to Speed up Genome Research

Hi Friends,

I just read an interesting article  and I would like to share some details with you.
Also in next few days I will share some AI (Artificial Intelligence  ) theory which I am preparing with my friend who is doing Phd in Mobile AI....

As of now below article is related to Azure....

A year ago at Virginia Tech researchers needed 2 weeks to analyze just 1 genome. Today, they can analyze 100 genomes each day. Why is this important? Scientists can learn more about our DNA and uncover more effective strategies for detecting, diagnosing, and treating diseases such as cancer. What’s helping to make this possible? An innovative solution developed by Virginia Polytechnic Institute and State University (Virginia Tech) that’s based on Windows Azure and the Windows Azure HDInsight Service.

There are currently an estimated 2,000 DNA sequencers generating around 15 petabytes of data every year.  Additionally, data volumes are doubling every 8 months, significantly ahead of Moore’s law of compute capability’s which is doubling only every 24 months.  Most institutions can’t afford to scale data centers fast enough to store and analyze all of the new information. To overcome this challenge, Virginia Tech developed a high-performance computing (HPC) solution with Windows Azure. It gives global researchers a highly scalable, on-demand IT infrastructure in the cloud that they can use to store and analyze Big Data, accelerate genome research, and increase collaboration.    

To make it easy for researchers to use the solution, Virginia Tech developed two cloud applications. One streamlines the creation of Genome Analysis Toolkit (GATK) pipelines (for DNA sequencing) using Windows Azure HDInsight. The other program simplifies the use of Hadoop MapReduce pipelines to automate data transfers and analyze information that resides on local and cloud-based systems in a hybrid scenario.

The new solution is saving Virginia Tech—and other organizations—millions of dollars because scientists pay only for the resources that they use. This includes Windows Azure Blob storage for temporary or long-term data storage and HDInsight clusters for on-demand HPC nodes. Provisioning a new resource takes just seconds.

Global scientists can also collaborate with less effort because they can now easily share insights and data sets virtually anytime, anywhere—and with any device. As a result, in the future scientists or doctors may be able to use the solution to develop custom treatments for individual patients faster, by engaging in genome analysis directly at hospitals.

Reference : SQL Server weekly ....

AngularJS (Part 1)

Are you curious about ng-JS (AngularJS)?
 AngularJS has custom elements and attributes
It uses dependency injection
AngularJS is a framework that helps you build front-ends(UI) for web-based applications.

“AngularJS is a prescriptive client-side JavaScript framework used to
make single-page web apps”


Core Features Of ng-JS (AngularJS)
Two Way Data Binding
Model View Whatever
HTML Templates
Deep Linking
Dependency Injection
Directives  

Two Way Data Binding.

      document.getElementById('yourName')[0].text = 'bob';

{{yourName}} -----DOM
    var yourName = 'bob';--------one place information
    ”$Scope enables two way data binding”
It makes it easy to change a value and effortlessly have it update the DOM.
No Repetition of code
No need to worry when to update DOM

MVVM Design
MVC Design Patterns
MVVM – Model View ViewModel


MVVM-How AngularJS is constructed?

 
 In the Part 2 we will explore more in details.
 If you have any comments than you can email me on viralpala@gmail.com

How to Pass PMP in First Try (Part 1)

On  January,2014, I have completed PMP exam. I would like to say thank you to each and every one who helped me in getting this certificate.

Now I thought to write blog on how to Pass PMP in First try…

     1)      What is PMP ?

PMP stands for Project Management Professional (PMP) is a credential offered by the Project Management Institute (PMI).

     2)      What you need before you apply for PMP ?

·        

       Bachelor Degree  + 4500 Hours of non over lapping Project Management Experience.  

·         35 PDU (professional development units (PDUs)) from registered REP.

    3)      How much time it will take ?

Depend upon your study time and experience , it took me 4 month. In this four month I read 2 hours during week days (Total 10 Hours) and 6 hours (total 12 hours ) during week end.

    4)      What is expenditure ?

·         PMI Fee : 129 $ + 10 $ (Application Fee) = 139 $

·         Training Fee : 100 $ - 300 $ depend upon from which REP you are taking training

·         Exam Fee : 405 $

·         Total Fee : 634 $ - 834 $

5) Is it mandatory to take Membership of PMI ?

No. It's not but I strongly suggest to take membership before you start.

reason is 

       1) If you are not member you need to pay 555 $ exam fee so it will be less if you become member and pay less fee, because you will get Member ship and exam fee in  545 $ but if you are not member you have to pay 555 $

     2)  you will get free copy of PMBOK 5 which is must need book.

     3)  you will get chance to be part of such a nice group.

   5)      First Step...

First step is you need to read PMBOK 5, once you get PMI membership you will get free copy of PMBOK which is specially licensed for only one , So I can not share this book with any one.

But once you get PMI membership you will get it free…

In My next article I will try to explain which other material you need to read and also which are the important and hard topic that you need to focus.

If you like this article than please make comment , if you don’t like please leave comment or email me on viralpala@gmail.com also let me know if I can help you in getting PMP certification .