Embed Size (px)
Citation preview
Binary Crosswordshttp://www.laurentcerveau.org
• Last time we talked about hiring an engineering team
• No we talk about creating a product with this team
• I do not pretend to give a top notch description of all technics mentioned here.
• In fact this is even be the opposite. This is not at all the purpose of the talk
• So again a manager oriented thing :-)
We start where we left
• You have ideas/specs/people (3)
• You ask around for all the best tool and technologies…a little bit
• You still want to believe technical development is deterministic
• You have read a book on how it works
• Your planning is so that you will get investor with a SkyRocket stuff in 6 months
Ready to make a product?
“Life is what happens when you’re busy planning other plans”
So after approximately 6 weeks
• You regret to have left your job to start a company
• You hesitate at learning all programming languages yourself: “I know it should be done this way”
• Process tools have already changed twice
• One guy has left, so you hesitate to fire a second one, because 3-2 = 1
Somewhere this is disturbing• The more you talk to so called “experts”, the
more you are confused
• You know where you want to go, and what your product should feel like.
• Simply you do not know which road to take, where to start fix it, and you need more than an anchor
• Time to step back
So let’s find our way
• Apprehend the technical complexity of a product of today
• Tune your setup
• Consider the constituting blocks, and what neuronal connections should be developed.
It’s so easy for your kids
Preamb: again, the following are based on my personal feelings along this path. I do not pretend to write an history
book.
A little bit of history
Dawn of personal computing
Unix MacintoshZX81
Micro Computing: we write applications to manipulate data and first of all to create documents (text, music, …) and move them
to an another support (CD, paper). Content is the output and we forget Unix
1970 1981 1984
A networks comes in
Server comes back : we write content to present it and technology to search it. Clients are strong but start to be seen as way to browse content, in addition to
create it. Age of “universal hope” : all Microsoft, all Java, all HTML
1993 1995 1998/91995
Mosaic Windows 95 Altavista Google
Free of my movements and friends
gmail iPhone
Mobile development is creating a stronger link client to server. Browsing of document turns to service (API). Social media provides influence of other. Cloud computing bring programmable computing power. Document export is now barely an issue (press online players,
Streaming music)
2004 2008 2008
2006
AWS creation
My data, my objects
2009 2010 2013
Big Data (Hadoop) Nest Founded Android market lead
Mobile becomes the number one priority. Technologies are created to handle massive data processing, connected object appears. We have gone so far from document creation. All this has become a full graph
and power consumption is a concern.
Complexity
Desktop computer
Mobile
Server
Connected objects
Complexity
Complexity
Complexity
Complexity
Paradox• The more complex it is, the easier it looks. Think
about how works a human body. Marvelous machine still not imitated
• In vast complex system, each small components brings its own world and complexity. A little bit like “all cells contains the DNA”
• A saying goes that the problems solvable by kids are the most complex one in computer science
Do not mix the small complexity versus the bigger vision one
Additionnally• Natural movement: when one has understood
something, it becomes a reference. But the more you deal with technology, the less you believe in one, and the more you think about the usefulness of all. Techno of today fades out tomorrow
• Creativity brings creativity. Why do some people still look for the universal programming language or method or whatever, when the global system is about individuality. Paradox with the natural movement.
Additionnally (2)• The more you advance in development the more
the simplicity of your product will translate into the proper use of complex technology
• Said differently : trying to force a complex system to fit into one simple view is like putting a circle in a square shape (of the same surface)
If you believe there is one “easy” solution you’re doomed ,After a while it is as much a question of feeling
than knowledge
Set up
Cards in hand
Humans
Tools
Means
Process
Cards in hand• Humans are your team. You should enthusiast
them every day, while driving strongly into one direction
• Means are all the technologies available. There are so many and understanding one is already a complex thing
• Tools are here to help you accomplish your goal. But they also require a learning curve and will do nothing by themselves
Process will transform all those elements in a fluid system
Humans
The CTO• A respectable CTO should be a at first a
choreographer
• A respectable CTO should still code with what he doesn’t know and knows how to debug.
• A respectable CTO should always have the question in my mind : “If I was really coming to this team today, how much time would it take for me to get in, and what would I understand in regards to the target goal”
Do not believe a CTO is only someone with “more technical knowledge”
The team• As a macro system/ as a micro system
• Macro should always prevail for a product development.Enforcing this will prevent individualism. This is management job
• Each ones brings competence and a Dreyfus level model to the macro system.
• Creating a grammar for the product in your team is essential
In the end, written form will prevail. The one who believes that it is evident because it looks like will lose.
Process- Engineering Project Manager
• EPM is a concept I met in a big company.
• Job description is “remove the road blocks”
• Takes note, nag people, manage the bug stack, do report. This is a no-bullshit role.
• Think about him/her as a second right hand
The only process that will work is the one that you work hard enough to transform into an habit. Someone needs to work
harder
Common pitfalls• Complexity is always done in the name of simplicity.
• After development freedom comes too much process
• “Do it now” works better in 75% of the cases. Otherwise write a bug
• Why are people so afraid to throw away things in the name of “in case of”. Throw them
• Avoid arguing, enforce rules
• A so called expert is having only his own brain
The advancing guitarist
By Mick Goodrick
“The best guitar book ever written””
Apply to software development
The advancing guitarist for product development
• Explore the power of limitations
• Don’t be too fast: spend time on all what you can get from a detail
• If you enter competition keep it for you. Works fine within your team. Being alone when you work, is the case in 90% of the situations
• Nothing is ever done. This is not the case in guitar learning, why would you believe it in Software development
Means
• The vast fields of available technologies
• Stuff of today will be partially obsolete tomorrow. Whatever people pretends. Still fundamentals stay. Each generation makes a problem important
• Choice is always a problem. Take the one that corresponds to your company need : recruiting, time to market, cost
Means
Can I develop faster with this one?
As a pure personal opinion, and based on my experience, I consider no technologies brings faster development in
absolute
But…• If you get class A developers, it will go faster
• Some technology will be faster to reach an intermediate state (e.g do I need a prototype)
• Some technologies will get an ecosystem momentum.
• There are always cases where a technology will fit your constraints (e.g databases)
• You may choose a technology for a part of the way and switch to another. Be contextual.
Tools
Rule of thumb
• The only good tool is the one you will adopt. No other. You often read “The tool does this”. This is not true: you do this
• You need basically
Bug system Build/Distribution System
Report & Test System
Bug system
Some example I did cross (Radar is missing :-()
It has to become the center point. This is the rule to enforce “write a bug”. Defer the philosophical
discussion on “is it a bug or a feature”
Anyway…it’s a clever todo list…
Build and Deployment system• Make software available as soon as it is done.
Everyone has the right to some regression
• Goes with creating different environments: prod, dev.
• Ensure the fact that “anyone” can deploy. If mistakes are made this will be a good lesson
• May be painful on mobile (provisioning profiles…)
• Goes also with a source version control system and with versioning
Better more versions, even not finished, than too less
Test and report system
• Testing has a value only if you test something that you believe will not happen
• Testing comes through usage. It is understanding how things should work
• Automate tests before a big operation : warning this is time consuming
• Reporting is way to link to the user: you may need to create it yourself
Example: mobile client reporting• Create a log system : defines event class ,
format, storage mechanism.
• First have user send it manually through email
• Format the email nicely
• Make sure it can be activated remotely
• Make an API to report it
• Have it work when no user is registered
Each step will help you understand what you track
From the start report
So what?
• The tool created here provides a common reference, a common vocabulary and talks to everyone
• It is a preamble to real user situation and so is not an “internal use tool only”
• It makes the team ask questions about what happens really in regards to what is supposed to happen
• It get cold facts
Digging into test and usage is about being drastically honest
Some Technical verbiage
Goal of this part
• Provides beacon, push all questions around one topic
• Give some familiar technology names
• Certainly not be exhaustive
Elements in the complexity
Infrastructure
Server
Mobile Desktop
Elements in the complexity
API
Language
Misc
Storage
Infrastructure
• The power engine of your system: compute, storage, network
• You’ve heard about cloud: infrastructure becomes programmable and instantly configurable: one more element gets the complexity DNA
• Main Providers
What are we talking about?
Many other players around
Answer to particular need, with different level of abstractions and easiness of manipulations. Complete ecosystem around
• Your system will have to be accessed, back-up, monitored, restored (in emergency), started and stopped potentially by many developers, secured, code deployed
• Contrary to the belief that it makes infrastructure easier, after a while cloud forces you to understand many concepts of networking
• With great power comes great responsibilities (this is a personal advertisement for Nephorider)
• The eternal question : it does not work the same on my local machine : Docker!
Implications
Languages
The short/no discussion version
• There is assembly
• There is C
• There is Lisp
• OK… maybe Java
Maybe it requires more: explore this
• Procedural, Object-oriented, functional
• Compiled, just in time compilation, interpreted
• Statically typed, dynamically typed
• On the client, on the server
A language provides a way to think about a problem
Servers
What server are we talking about?
• Web server versus application server
• Web server deals with the requests
• Application servers do the work
• Between them there is something called CGI (roughly).”I pass the work to my neighbor”. When it fails find which one.
Web servers
• The first in line: needs to be fast
• Multiple server for fixed constants and fast answer: CDN
• Handle protocol. Remember 80 (non secure) and 443 (non secure) : verify you talk to the right guy, speak in coded language. Read hackers book
Application servers
• May or not work in a CGI like setup (PHP)
• They bring a methodology to develop application (MVC)
• They link endpoints request to objects, concepts and storage
API
Scope of word: application programming interface
• Exposes a nice learnable and usable model with a set of functions of methods of the concept of your product
• Apply also to the libraries and frameworks you are using
• Not an HTTP only concern of course!!!
• Should never exposes how it is implemented
Some principles
• Make sure it is learnable easily if you want it to be adopted
• Make sure it is 200% coherent
• Use the HTTP vocabulary available, read about REST concepts
• Make it auto describing : no ambiguity when reading…or parsing. Uniquely identify each entity
Words you may bumped into
• Slices (things little by little), fields (get only partial elements in answer)
• JSON means nothing
• XML neither…
Storage
Storage for what?
• Organize and keep data “that has a meaning”
• Stored data has another form than live one. It may requires extra data to access it fast
• Always question of compromises : how much size to store it, how fast can you access it, how fast can you write it
• Growth of the system is important (sharding)
Databases, databases• At first we all wanted to think structurally
• SQL is a programming language designed for managing data held in a non relational database manegement system.
• We can say this is talking about a model
The NoSQL movement• Different types all addressing a particular
problem in the SQL world or dealing with particular type of data, in some memory configuration
• Do not use it only to “do NOSQL”. When you use it , adopt the mindset
Document Graph
Key-Value Column based (Big data oriented)
Desktop
One of the most famous technology trio
Looks so easy it becomes incredibly complex and powerful
• Originally Document based
• Separation of content and display
• Document became programmable and turned into applications
• Integrate in an ecosystem : tags are element of a semantic puzzle (e.g SEO)
Evolutions
• Full feature frameworks (AngularJS, EmberJS…) provides methodology to develop application
• Graphics become more elaborate (e.g SVG)
• Handle different output device (e.g Bootstrap) this is what is called “responsive”
Strangely enough I find it has less profusion of “new” technologies…but this is very personal
Mobile (native)
Lanscape
Send back to the past
• Back to some “forgotten” problems
• Power consumption, network quality, speed of execution
• But way more demanding as “output level” : usability, animation…
Communication device
• Not only as phone
• But as a set of sensors for me (e.g GPS…)
• 2 paths communications: normal HTTP, Notifications in all ways (APN…)
Misc
• Search : use component (ElasticSearch) or Service (Algolia)
• Social networks : gives at first a way to identify yourself, but also access to a vast database of data/users (OpenGraph)
• Measure your result : Analytics
A few more things to thing about
Thank You!
