It doesn't have new concepts - all of the concepts are old and lifted from other functional languages. I have learned it.
It lacks frameworks for setting up servers using it, and up until now the only servers it would run on would be OS X servers. I like OS X on my development machine, but I wouldn't want hundreds of OS X servers - I'd much rather have Cent OS servers since it's more economical. So I stick with Python and the Twisted framework.
On the front end for games, I use Unity 3D. Right now, Unity 3D's best supported language is C#, so that's what I use. If they support Swift in the future and have better performance with it, I would consider switching. If a competitor to Unity 3D existed, I would consider using it (but I'm already rather invested in Unity 3D, and it's hard to say anything negative about Unity 3D).
On the front end for other projects... well, I don't have any other front end projects right now I'm working on, so I honestly haven't examined that landscape in awhile. Last I checked, I liked Python + TK a lot, but that's limited to Desktop only... I wish there was a TK for web UI...
I don't think you really understand why Swift exists. You should really read some of the things
John Siracusa's section on Swift from his OSX 10.10 review (he's been talking about this for
at least 10 years!) about the state of Apple's developer technologies. Basically, Swift has to be higher-level than Objective-C, while being as fast (or faster) than C, enforcing code safety while being easy to learn and fast to write.
Of course they have lifted concepts from other programming languages. Do you know anything about programming languages? They take concepts from each other all the time! That is exactly how our current suite of programming languages evolved! Even C has some heritage, you know - these things don't just pop out of the ground (well, except Brainfunk); it took concepts from ALGOL, for example (which in turn was built as an improved FORTRAN). Basically every language since C has taken concepts from C.
Swift is still only 2 years old and the focus is about getting the foundations done, but it does have some unique characteristics (such as the focus on value types). As with people, it will develop a more characteristic 'identity' as it matures.
Your point about CentOS servers are kind of relevant here: this is kind of the point behind Apple open-sourcing the language. They've provided an official Ubuntu port, and since it's open I'm sure people are working to bring it to all the rest of them as we speak.
Apple doesn't even make Mac servers any more. That means that until today the target audience for Swift programs was mostly consumer-grade hardware doing consumery-type things. Today it becomes a different animal: it's now on generic hardware doing anything you like. It has enough momentum and developers familiar with it to really compete with, say, Python in the near future.
You will see more server frameworks for Swift. It didn't make sense in a Mac-n'-iOS-only world, but now it's more interesting.