(busy music)
>> Announcer: Live from Midtown Manhattan,
it's the Cube, covering Big Data New York City 2017,
brought to you by SiliconANGLE Media
and its ecosystem sponsors.
>> Hello, and welcome to the special Cube presentation
here in New York City for Big Data NYC,
in conjunction with all the activity going on
with Strata, Hadoop,
Strata Data Conference right around the corner.
This is the Cube's special annual event in New York City
where we highlight all the trends, technology experts,
thought leaders, entrepreneurs here inside the Cube.
We have our three days of wall to wall coverage,
evening event on Wednesday.
I'm John Furrier, the co-host of the Cube,
with Jim Kobielus,
and Peter Burris will be here all week as well.
Kicking off day one, Jim, the monster week of Big Data NYC,
which now has turned into, essentially,
the big data industry is a huge industry.
But now, subsumed within a larger industry
of AI, IoT, security.
A lot of things have just sucked up the big data world
that used to be the Hadoop world,
and it just kept on disrupting,
and creative disruption of the old guard
data warehouse market, which now,
looks pale in comparison to the disruption
going on right now.
>> The data warehouse market is very much vibrant and alive,
as is the big data market continuing to innovate.
But the innovations, John, have moved up the stack
to artificial intelligence and deep learning,
as you've indicated, driving more of the Edge applications
in the new generation of mobile and smart appliances
and things that are coming along like smart,
self-driving vehicles and so forth.
What we see is data professionals and developers
are moving towards new frameworks,
like TensorFlow and so forth,
for development of the truly disruptive applications.
But big data is the foundation.
>> I mean, the developers are the key, obviously,
open source is growing at an enormous rate.
We just had the Linux Foundation,
we now have the Open Source Summit,
they have kind of rebranded that.
They're going to see explosion from code
from 64 million lines of code to billions of lines of code,
exponential growth.
But the bigger picture is that it's not just developers,
it's the enterprises now who want hybrid cloud,
they want cloud technology.
I want to get your reaction
to a couple of different threads.
One is the notion of community based software,
which is open source, extending into the enterprise.
We're seeing things like blockchain is hot right now,
security, two emerging areas that are overlapping
in with big data.
You obviously have classic data market,
and then you've got AI.
All these things kind of come in together,
kind of just really putting at the center of all that,
this core industry around community
and software AI, particular.
It's not just about machine learning anymore and data,
it's a bigger picture.
>> Yeah, in terms of a community,
development with open source,
much of what we see in the AI arena, for example,
with the up and coming, they're all open source tools.
There's TensorFlow, there's Cafe,
there's Theano and so forth.
What we're seeing is not just the frameworks
for developing AI that are important,
but the entire ecosystem of community based development
of capabilities to automate
the acquisition of training data,
which is so critically important for tuning AI,
for its designated purpose,
be it doing predictions and abstractions.
DevOps, what are coming into being are DevOps frameworks
to span the entire life cycle of the creation
and the training and deployment and iteration of AI.
What we're going to see is, like at the last Spark Summit,
there was a very interesting discussion
from a Stanford researcher,
new open source tools that they're developing out in,
actually, in Berkeley, I understand,
for, related to development of training data
in a more automated fashion for these new challenges.
The communities are evolving up the stack
to address these requirements
with fairly bleeding edge capabilities
that will come in the next few years
into the mainstream.
>> I had a chat with a big time CTO last night,
he worked at some of the big web scale company,
I won't say the name, give it away.
But basically, he asked me a question about IoT,
how real is it,
and obviously, it's hyped up big time, though.
But the issue in all this new markets like IoT and AI is
the role of security,
because a lot of enterprises are looking at the IoT,
certainly in the industrial side has the most relevant
low hanging fruit,
but at the end of the day, the data modeling,
as you're pointing out, becomes a critical thing.
Connecting IoT devices to, say, an IP network
sounds trivial in concept, but at the end of the day,
the surface area for security is oak expose,
that's causing people to stop what they're doing,
not deploying it as fast.
You're seeing kind of like people retrenching
and replatforming at the core data centers,
and then leveraging a lot of cloud,
which is why Azure is hot,
Microsoft Ignite Event is pretty hot this week.
Role of cloud, role of data in IoT.
Is IoT kind of stalled in your mind?
Or is it bloating?
>> I wouldn't say it's stalled or that it's bloating,
but IoT is definitely coming along
as the new development focus.
For the more disruptive applications
that can derive more intelligence directly to the end points
that can take varying degrees of automated action
to achieve results,
but also to very much drive decision support in real time
to people on their mobiles or in whatever.
What I'm getting at is that IoT is definitely a reality
in the real world in terms of our lives.
It's definitely a reality in terms of the index generation
of data applications.
But there's a lot of the back end
in terms of readying algorithms and in training data
for deployment of really high quality IoT applications,
Edge applications,
that hasn't come together yet in any coherent practice.
>> It's emerging, it's emerging.
>> It's emerging.
>> It's a lot more work to do.
OK, we're going to kick off day one,
we've got some great guests,
we see Rob Bearden in the house, Rob Thomas from IBM.
>> Rob Bearden from Hortonworks.
>> Rob Bearden from Hortonworks, and Rob Thomas from IBM.
I want to bring up, Rob wrote a book just recently.
He wrote Big Data Revolution,
but he also wrote a new book called,
Every Company is a Tech Company.
But he mentions, he kind of teases out
this concept of a renaissance,
so I want to get your thoughts on this.
If you look at Strata, Hadoop, Strata Data,
the O'Reilly Conference,
which has turned into like a marketing machine, right.
A lot of hype there.
But as the community model grows up,
you're starting to see a renaissance
of real creative developers,
you're starting to see, not just open source, pure,
full stack developers doing all the heavy lifting,
but real creative competition,
in a renaissance, that's really the key.
You're seeing a lot more developer action,
tons outside of the, what was classically called
the data space.
The role of data and how it relates
to the developer phenomenon that's going on right now.
>> Yeah, it's the maker culture.
Rob, in fact, about a year or more ago,
IBM, at one of their events,
they held a very maker oriented event,
I think they called it Datapalooza at one point.
What it's looking at, what's going on is
it's more than just classic software developers
are coming to the fore.
When you're looking at IoT or Edge applications,
it's hardware developers, it's UX developers,
it's developers and designers who are trying to change
and drive data driven applications
into changing the very fabric of how things are done
in the real world.
What Peter Burris, we had a wiki about him
called Programming in the Real World.
What that all involves is there's a new set of skill sets
that are coming together to develop these applications.
It's well beyond just simply software development,
it's well beyond simply data scientists.
Maker culture.
>> Programming in the real world is a great concept,
because you need real time, which comes back down to this.
I'm looking for this week from the guests we talked to,
what their view is of the data market right now.
Because if you want to get real time,
you've got to move from that batch world
to the real time world.
I'm not saying batch is over,
you've still got to store data,
and that's growing at an exponential rate as well.
But real time data, how do you use data in real time,
how do the modelings work, how do you scale that.
How do you take a DevOps culture to the data world
is what I'm looking for.
What are you looking for this week?
>> What I'm looking for this week,
I'm looking for DevOps solutions or platforms
or environments for teams of data scientists
who are building and training and deploying
and evaluating, iterating deep learning and machine learning
and natural language processing applications
in a continuous release pipeline, and productionizing them.
At Wikibon, we are going deeper in that whole notion
of DevOps for data science.
I mean, IBM's called it inside ops, others call it data ops.
What we're seeing across the board
is that more and more of our customers
are focusing on how do we bring it all together,
so the maker culture.
>> Operationalizing it.
>> Operationalizing it, so that the maker cultures
that they have inside their value chain
can come together and there's a standard pattern workflow
of putting this stuff out and productionizing it,
AI productionized in the real world.
>> Moving in from the proof of concept notion
to actually just getting things done,
putting it out in the network,
and then bringing it to the masses with operational support.
>> Right, like the good folks at IBM
with Watson data platform, on some levels,
is a DevOPs for data science platform,
but it's a collaborative environment.
That's what I'm looking to see,
and there's a lot of other solution providers
who are going down that road.
>> I mean, to me, if people have the community traction,
that is the new benchmark, in my opinion.
You heard it here on the Cube.
Community continues to scale,
you can start seeing it moving out of open source,
you're seeing things like blockchain,
you're seeing a decentralized Internet
now happening everywhere,
not just distributed but decentralized.
When you have decentralization,
community and software really shine.
It's the Cube here in New York City all week.
Stay with us for wall to wall coverage through Thursday
here in New York City for Big Data NYC,
in conjunction with Strata Data,
this is the Cube, we'll be back with more coverage
after this short break.
(busy music)
(serious electronic music)
(peaceful music)
>> Hi, I'm John Furrier, the Co-founder
of SiliconANGLE Media, and Co-host of the Cube.
I've been in the tech business since I was 19,
first programming on mini computers
in a large enterprise,
and then worked at IBM and Hewlett Packard,
a total of nine years in the enterprise,
various jobs from programming, training, consulting,
and ultimately, as an executive sales person,
and then started my first company in 1997,
and moved to Silicon Valley in 1999.
I've been here ever since.
I've always loved technology,
and I love covering emerging technology.
I was trained as a software developer and love business.
I love the impact of software and technology to business.
To me, creating technology that starts a company
and creates value and jobs
is probably one of the most rewarding things
I've ever been involved in.
I bring that energy to the Cube,
because the Cube is where all the ideas are,
and where the experts are, where the people are.
I think what's most exciting about the Cube
is that we get to talk to people
who are making things happen,
entrepreneurs, CEO of companies, venture capitalists,
people who are really, on a day in and day out basis,
building great companies.
In the technology business,
there's just not a lot real time live TV coverage,
and the Cube is a non-linear TV operation.
We do everything that the TV guys on cable don't do.
We do longer interviews, we ask tougher questions.
We ask, sometimes, some light questions.
We talk about the person and what they feel about.
It's not prompted and scripted, it's a conversation,
it's authentic.
For shows that have the Cube coverage,
it makes the show buzz, it creates excitement.
More importantly, it creates great content,
great digital assets that can be shared instantaneously
to the world.
Over 31 million people have viewed the Cube,
and that is the result of great content,
great conversations.
I'm so proud to be part of the Cube with a great team.
Hi, I'm John Furrier, thanks for watching the Cube.
>> Announcer: Coming up on the Cube,
Tekan Sundar, CTO of Wine Disco.
Live Cube coverage from Big Data NYC 2017
continues in a moment.
>> Announcer: Coming up on the Cube,
Donna Prlich, Chief Product Officer at Pentaho.
Live Cube coverage from Big Data New York City 2017
continues in a moment.
>> Announcer: Coming up on the Cube,
Amit Walia, Executive Vice President and
Chief Product Officer at Informatica.
Live Cube coverage from Big Data New York City
continues in a moment.
>> Announcer: Coming up on the Cube,
Prakash Nodili, Co-founder and CEO of Pexif.
Live Cube coverage from Big Data New York City
continues in a moment.
(serious electronic music)