IBM

Dog Vision: Putting Dogs and Doing Good Together @ IBM

Me playing with one of the really cute puppies at the shelter

Me playing with one of the really cute puppies at the shelter

I’m a huge dog lover, like the biggest dog person you’ve ever met. And as a big dog person, the biggest problem for me is that I have no dogs at home. That’s why I decided to go to the Humane Society this summer and see how hard it would be to possibly adopt one.

Now one major thing that working on startups has kind of engrained in me is a lot of lean startup methodology, specifically when it comes to customer discovery. And its led me to always want to understand more about everything around me and how it works, not specifically looking for problems but more like stumbling across them. In the process of understanding how adoptions work, I had the opportunity to talk to 6 different staff and volunteers just casually asking them about their jobs and experiences. As I spent more time just talking to them, each of them individually spoke about different problems and pain points in the adoption process. At the end of the day, I not only walked away with a huge amount of respect for all the volunteers and staff, but also a fundamental problem shelters were facing: no one knew what types of dogs they were giving to families.

I learned that a lot of the dogs that come through my local shelter are from rural communities which many times don’t have a lot of background history associated with them. When the shelter takes dogs in from literally anywhere, they have a staff member basically “eyeball” what type of dog they are dealing with. As a result there is no way to actually know which type of dog people are adopting. Now one common solution to this could be genetic testing each dog that comes through, but at 100 dollars a genetic test for a dog its a non starter for a lot of non profits who don’t have the budget for it. Not to mention the month it would take to get the results back, during which these dogs would not be able to have a home and stuck in the shelter.

Me with one of the volunteers at the shelter

Me with one of the volunteers at the shelter

After going home I decided to do some additional research and find if this was an isolated problem. And it turns out, my local shelter is not alone at all. In fact at many shelters dogs are misclassified into wrong breeds, and the result is they take longer to get adopted or face a higher rate of returns back to the shelter.

Now one of the really amazing things about being a Cognitive Applications Technical Intern is I get to work with some of the most advanced and cutting edge technologies that run on IBM’s cloud. And when you work 40 hours a week on something that you think is really amazing and cool, your problem solving mindset does just magically switch off after your normal 9-5 job. So I came up with an interesting idea: What if instead of a human “eyeballing” what breed a dog was we had IBM Watson do it instead.

Through a combination of open source data sets I was able to build a custom machine learning model that was able to determine what guess what breed a dog was. Now one thing that really goes understated a lot of time is the amount of time you need to find getting, cleaning and optimizing the right data. I some really great learning experiences trying to do a lot of the data wrangling there and even learning how to write some scripts to automate the process.

After I built the model, I made a simple iOS app for volunteers and staff at the shelter to use it. The UI is pretty simple since this is all a MVP. But essentially you open the app, take a photo of a dog, and you get the results of what breed the model thinks it is. Right now the model I built is trained on about 20,000 dog photos and around 120 or so different breeds.

A screenshot of the MVP running on my phone.

A screenshot of the MVP running on my phone.

With a MVP in hand and research and customer discovery interviews done I was able to go back to my local dog shelter and propose this project I built. I made a short presentation to their leadership of the shelter which is attached below.

Screenshot 2019-08-05 14.40.28.png

Screenshot 2019-08-05 14.40.36.png
Screenshot 2019-08-05 14.40.43.png
Screenshot 2019-08-05 14.40.57.png

The leadership of the shelter loved the idea, and currently I’m in the process of making some improvements on the app and model in order to conduct a pilot program to see the actual impact this has on finding these cute amazing doggies a home.

Hacking @ IBM Intern Hackathon - Making the Internet Accessible

IMG_2091.JPG

I had a great time working with a couple of the other SF interns for the IBM intern hackathon. One of the amazing things about this project was that our team chose to not only build a project that had a strong business case for IBM, but also had a strong social impact for the visually impaired who use the internet.

We made a video of product demo. Feel free to check it out below:

We also made a brief overview handout for the judges since they were all IBM executives. The results really speak for themselves, check it out below.

Screenshot 2019-07-30 15.26.27.png
Screenshot 2019-07-30 15.26.37.png

Our team also worked on making some really funny photos to post on our Team Twitter account to show just how cool working at IBM was. Here is my favorite of our team bowing down at the IBM Watson desk in our office.

Volunteering @ GLIDE SF Homeless Shelter

Today I had the great experience of going to the Tenderloin district with a couple of my fellow interns after work and spending the evening volunteering. As a coder I pride myself on my physical ability. After-all coding for hours a day means that my hand muscles are in tip top shape. I was able to use those skills not only for coding today, but to serve almost 450 hot meals at a homeless shelter today.

Exploring the Watson Experience

One of the benefits working in the Watson West building in SF is that my building holds the Watson Experience Center. “The IBM Watson Experience Centers are permanently branded experiences, with locations in New York City, San Francisco, and Cambridge. The centers are invitation only and their primary audience is potential customers of IBM Watson.”

It was amazing going inside the center where they immerse you with the real world use cases of IBM technologies and the inside secrets the presenters use in order to wow CEOs of major companies who come in for a visit. Sadly the facility doesn’t allow photos inside so I can’t show any of the cool stuff that happened inside the room.

IMG_1877.jpg

Exploring @ IBM Silicon Valley Lab and Almaden Research Lab

IBM R.jpg

This week I had an amazing time exploring other IBM offices all around the bay area, not just in SF where I am based. I had a great time meeting Dinesh Nirmal and Nimesh Bhatia and spending the day at IBM Silicon Valley Lab with my fellow interns in the morning. Dinesh is the site executive of Silicon Valley Lab and is the VP of AI and Data at IBM. I was part of a group of interns who got to have a meeting with him and ask him questions about the future of IBM in the cloud and in enterprises.

After exploring SVL, we went over to the Almaden Research Lab and saw all the amazing work happening with quantum and neuromorphic computing under Jim Spohrer, Kevin Roche, and Myron Flickner.

IBMr3.jpg

Mentoring @ Angel Hacks Silicon Valley

IMG_1833.jpg

This weekend I had the amazing opportunity of being able to help mentor hackers and represent IBM at Angel Hacks Silicon Valley. It was really amazing being able to spend the day on the floor of the hackathon and meet and help developers who needed help troubleshooting their code or just wanted to learn more and ask questions about the cool stuff that IBM was working on.

This 24 hour hackathon saw over 120+ competitors come together to form more than 40 teams at School 42, an alternative tech school in Fremont which offers completely free tuition and housing to their students. Unrelated, but this school had probably the best hackathon food I’ve ever had.

I’m really thankful IBM offers their technical interns the amazing opportunity to help out at these types of events. For me its really important to give back and help educate the next generation of hackers given that I’ve learned so much in the hackathons I’ve participated in.

One of the really nice things that I liked about this hackathon was the fact that they allow each of their sponsors to set up different objectives for what they want the projects to address. IBM in specific wanted hackers this year to work on projects related to Call for Code, which is essentially an investment not only in millions of dollars but also IBM staff and resources to help create better responses to natural disasters. Specifically in this hackathon IBM wanted developers to work on “an application using cloud, data, analytics, AI, IoT, blockchain to improve disaster preparedness, response, recovery or building back better focused on the health and well-being of individuals and communities.”

IMG_1827.jpg

Specifically 3 projects that I really really liked were:

  1. Advancers AI - This team from Myanmar was able to create a smartphone application that is able to identify malaria more accurately and with greater throughput than the current rapid malaria test which is currently done in 3rd world countries. They were able to get actual training data from hospitals in Myanmar and have a 97% accuracy using their smartphone. I thought this one was the coolest. Also as someone who had malaria when I was in India, I have a personal experience knowing how horrible it is.

  2. ML Matter - This team wanted to help big disaster relief organizations in both the private and public sector access to data that could help speed up their response and help them evaluate where to send the most resources in the aftermath of a natural disaster. Their application takes images before and after a natural disaster and is able to determine which pieces of infastructure: roads, bridges, buildings, etc are down.

  3. AIDOC - This team was able to create an AI triaging system which could have possible uses in the aftermath of a natural disaster. In the hackathon the team was able to implement two different types of tests using AI. The first was a vision test which could be used to diagnose eye problems. The second was a skin analyzer which was able to tell if certain rashes or spots on a person are a major cause for concern.

Hosting @ IBM BlockChain Developer Conference

I had an amazing time working with the SF city team today getting to help host the IBM BlockChain Developer Conference. One of the perks of hosting the conference was that I was able to meet a lot of the really cool speakers.

Of the many amazing people I met today I really want to highlight 2 of the really really really amazing speakers I met.

IMG_1733.jpg

The first was Sandy Khaund. Sandy was founder and CEO of Upgraded which really took the Block Chain to heart and turned traditional event tickets into secure digital assets through smart contracts. What really impressed me about Sandy wasn’t just how technologically complex his startup was, but how he found an actual use case where there was an extremely compelling business case for the technology. This was made clear when TicketMaster ended up acquiring his startup and bringing him in as their VP of Block Chain Products.

Porter.jpg

The next really amazing person I met was Porter Stowell, the head of Block Chain strategy here at IBM. Porter had flown across the country to attend the conference and it was amazing hearing him tell me about some of the really amazing projects in the space. One thing that is amazing about IBM being a huge company is the fact that they have a lot of resources they can put toward pilots. Whether that be in shipping or healthcare, IBM is working with a lot of partners who want to explore Block Chain, and it was great to meet the person leading the charge.

Elevator Talk with SVP of Cognitive Applications: Bob Lord

IMG_1711.jpg

I had an amazing time getting to talk to Bob Lord the Senior Vice President of Cognitive Applications, the group in IBM that I’m interning in this summer. For those of you outside of IBM, Bob Lord is literally a legend among IBMers. In my first week I heard chants of his name among the other interns.

So when I found out he was coming to my office in SF I decided to introduce myself as an intern and get a photo with him. It just so happened that we were heading out from the office at the same time and got into the same elevator. It gave me the once in a life time opportunity to ask the head of my division questions about IBM.

My first one was what tips he had for a new IBMer. His advice was to really take advantage of all the events and summits happening in SF, not only within IBM but throughout the city. To him being one of only 4 undergraduate interns in the SF office meant that I had a very rare opportunity to soak up as much as I could from the highly technical and dynamic staff in my building.

The second one was what he thought was the coolest technologies at IBM. This was a bit longer of a conversation. And I’m really thankful that we left right as every other person on different floors were leaving, because it meant that our elevator stopped on each of the 8 floors we were going down from. To him, he saw IBM’s Block Chain as the coolest technology and one that was vastly underestimated. “Too many people confuse Block Chain with the value of cryptocurrencies like BitCoin.” We ended up having a conversation about the future of cryptocurrencies and the need for stable-coins in the future. After we got down to the lobby I thanked him for his time and we parted ways. Overall though it was an amazing experience getting to talk to him.